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ABSTRACT 
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decision maker ' s semantic memory. It is suggested that these 
heuristics can be incorporated into decision aids designed to improve 
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development of such decision aids are identified and criteria for 
locating the operation site of heuristics are developed. The 
preliminary implementation of heuristic aiding devices within one 
particular decision aid, Multiattr ibute Utility Decomposition (MftUD) , 
is briefly described, Heuristics that operate on the interface with 
semantic memory are identified within a comprehensive table of 
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further development of automated decision structuring systems by the 
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STRUCTURING DECISIONS: THE ROLE OF STRUCTURING HEURISTICS 



BRIEF 



Requirement: 



To investigate if and how subjective judgmental heuristics can be incor- 
porated into a computer interactive decision-making aid. 

o 

Procedure : >. 

Review and critiques of the following topics were made: the development 
of decision-theoretic systems, decision theory, "heuristic devices, and classi- 
fication of heuristics.. A computer aid was developed using heuristi 3 to sup- 
port the structuring and evaluation of a decision or problem. 

o 

.. • : 

Findings: 

The current view of judgmental heuristics as biases is' challenged on the 
ground's that the biasing nature of some of the heuristics has hot been repli- 
cated in the degree, and, in some cases, in the direction of the bias. An al- 
ternative is to view Heuristics as devices for integrating the decision maker s 
semantic memory With the decision-theoretic techniques. In addition, it was 
possible to identify areas in the decision-making process in. which heuristic 
rather than normative algorithmic procedures should be used. A comprehensive 
categorization of heuristics was generated. A decision aid, Multiattribute 
Utility Decomposition (MAUD) , is used to demonstrate how heuristic. devices 
can be used to handle the transactions across the decision-theoretic computer- 
ized system arid tihe decision maker's semantic memory. Specifics on the MAUD 
system are summarized in Technical Report 543. 

Utilization of Findings- 



This report will be of use to those : interested in understanding the _ 
psychological means of supporting decision making,, Due to . their technical and 
exploratory nature, the materials presented will^be of limited value for imme- 
diate application Rather, their merits. will be realized as a stimulus for 
researching .botfi^the empirical psychological Support and the efficacy of such 
concepts in decision aiding. 
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1 . SUMMARY 



* This paper^discusses how heuristics can be incorporated in" decision _?_ ids 
used for structuring decision problems. First, we describe decision theory 
iti terms of linked subsystems; this permits us to identify the sites in which 
it is necessary to employ heuristic rather than normative algorithmic proce- 
dures'; These sites lie on the interface between decision- theore tic subsystems 
and the decision maker's semantic memory/ because no adequate formal specifica- 
tion of the structure _bf semantic memory exists as yet, and consequently no 
normative procedures for accessing ihf drmation A f roin semantic memory can be 
specified. Next, we rnake use of production systems to describe heuristic de- _ 
vices handling transactions across the interface between the decision-theoretic 
system and the decision maker's semantic memory and suggest that these heuris- 
tics can be incorporated into decision aids designed to improve the quality of 
access to the information contained within the decision maker's semantic memory 

e - * - - 

We ide ntify candidate heuristics for use in development of 'such decision 
aids. We deve lop criteria for locating the operation site of heuristics re- 
ported in the literature and then select those heuristics that operate on the 
interface with semantic memory . These heuristics axe identified within a com- 
prehensive .table of heuristics cited in the literature. ) 

2. INTRODUCTION 



Interfacing Machine-Client-Decision Analyst; What Next? 

A fundamental problem in decision analysis is the extent to which the 
decision maker should work directly in interaction with a decision analyst, 
or instead, interact with' an automated decision aid ih building^ exploring, 
and evaluating a decision-theoretic model of the problem being considered. 
Should decision aids be interfaced directly with the decision maker, or should 
the decision analyst serve as an intermediary, retaining control of the over- 
all structuring of -the problem, but using a decision aid to perform the more 
"automatic" functions (such as applying a multiattribute utility composition 
rule, rolling back a decision tree, ahd so on) ? Initially, automated aids 
were designed with the goal of "bootstrapping" the decision maker (Dawes & 
Corrigan, 1975). Automating a decision maker's composition rule provided 
judgments superior to his or her unaided intuitive judgments. Subsequently, 
it was realized that structuring and' decomposition operations might also be 
profitably aided (Selvidge, ..1976) . Humphreys (1978b) found that it was £he 
structuring capability 'of a bootstrapping aid that was valued, particularly 

Vfcy those decision makers who were initially unsure about their preferences 

• and goals - 

However, designing a decision aid with structuring capability does not 
involve simply an extensipn of the devices employed in aids designed to auto- 
mate composition rule s . As we show in section 3 , decision theory specifies 
completely how the elements of a decision are to be combined, but it provides 
only a limited set of rules about how the elements should be structured (e.g., 
events should be mutually exclusive and exhaustive) . Thus, heuristic devices 



li 



the final structure is valid and internally consistent. . . 

' The research program reported here was concerned with both || design of 
a structuring aid and the identification of heuristics that can f ^litate 
structuring activity. . 

problems involving uncertainty. Specifically, tne _orig-.no * v 
to this work called for the following tasks to be carried out. 

. 1. Develop interactive Multiattributc Utility Theory (MAUT) aid with 
dynamic capability, 

2. collect and investigate heuristics useful for provisional 
structuring, and 

3. Identify and program useful probability assessment procedures, 
qoon after we started this work, a new conceptualization- of decision 

liofof tne SIra ure "alon KtTI^ation ^^^^^ 

and'suggest uses for heuristic devices within this process. 

3. THE PROVINCE OF DECISION THEORY 



Overview 



^ -~ 4-1,=.+- tt- ronsists of four interlocking sys- 

Our view of decision theory is that it consists pi r our ,„. .. ith thc 

interface = 6W « ? ly specifies the [-° f ^«^ Stiiity o£ 

tions when folding back an act-event tree. 

AithouW a S =i 3 i»n tteorv prescribes these sysEen, s sfo »»ii«K J||,ffi« 

sors arms see 
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whereas judgments by experts are the main inputs in clinical art applications; 
Subjective judgments necessarily involve semantic memory systems (Anderson > 
.1976): However, the province of decision theory (Liridley^ 1974) does hot in- 
clude models of semantic memory nor of the environment. 

In thfe remainder of section 3 we will outline briefly the historical : s 
development of decision theory into the four interlocking systems. In section 
4, we will demonstrate 'how procedures that involve passing information across 
an interface between a system modeled within decision theory and the decision 
maker's cognitive information processing .system require the use of rules spec- 
ifiable only as heuristic devices, outside the axiomatic formulation of deci- 
sion theory. 

3.1 Historical" Development of Decision-Theoretic Systems 

Decision theory has, since its inception, been concerned with the decompo- 
sition of immediate acts (Bernoulli, 1737) . 1 Acts can be decomposed into the 
set of their possible consequences, each described by a payoff function index- 
ing the value gained or lost through the realization of that consequence. 
Given the assumption that the decision maker will choose a specific subsequent 
act in each eventuality under consideration, the decision analysis can be con- 
ducted by constructing a payoff -matrix. Each cell in this matrix defines a 
particular act-event sequence, the consequence of which is represented by a 
payoff shown in the cell. This is known as^the normal form of decomposition 
of immediate acts through act-event sequences. 

An altnerative decomposition of immediate acts through act-event sequences 
is known as the extensive form, usually represented as a decision tree. Here 
the links between all immediate acts, events , subsequent acts, and consequences 
under consideration are linked in a tree structure containing act nodes and 
event nodes . The left-hand side of the tree starts with a simple immediate 
act node, and the right-hand side ends with a set of consequences. The set of 
payoffs associated with these consequences can be used to fill the cells of a 
payoff matrix identical to that obtained through a normal form, decomposition 
of the same problem. The diff erence , however , is that an extensive form struc- 
turing of the problem allows' one to fold back the decision tree piecemeal, 
examining expected utilities at intermediate nodes in the tree , and providing 
expected utilities for immediate acts. 

Hence , we can see. that normal form and -extensive fo^m 2 decompositions of 
a set of immediate acts' into events, subsequent acts, and consequences differ 
only in that the extensive form provides the decomposition in a more structured 
way, allowing an analysis of the problem in partially decomposed form, as well 
as in; holistic and fully decomposed form. Both the normal and extensive forms 



Bernoulli was concerned with, among other things, the question why people . 
ever answered the question, "Should I buy insurance now?" in the affirmative. 

2 See Luce and Raiffa (195 7, chapter 3) ,for a de tailed description of normal 
and extensive form decomposition . 
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are what we will call single-system decompositions^ and in this section we 
shall trace the history of decision theory, starting with these single-system 
decompc rttions, "up to its present . state of development in which decision prob- 
lems can be subjected to decompositions by four separate but interlocked 
systems. 

At the outset of this development, about 20 years ago* initial research 
emphasis was on the nature of the optimal composition rule for use within the 
single decomposition system in prescribing a preference function over the set 
of immediate acts, so that the optimum immediate act could be chosen under any 
circumstances (barring hindsight) . Later, as a consensus began to develop 
around the advocacy of the subjective expected utility (SEU) rules as the 
normatively preferred composition rule (Edwards , Lindman, & Phillips , 1965; 
Lee, 1970) , the emphasis shifted to the nature of the optimal structuring of 
the decision problem (e.g., Brown , 1977) in conjunction with the question, 
How should the structure adopted be extended or constrained in the light of 
difficulties likely to be encountered in interfacing it with the decision 
maker and the environment? 

Figure 1 shows the interfaces involved, together with the inputs and 
outputs crossing these interfaces. ■ 

Within personalist decision theory, the decision- theoretic model is not 
interfaced directly with the environment, but environmental inputs and outputs 
are mediated through the decision maker's judgments. This process involves 
the invocation of semantic memory in the provision of "knowledge of the world" 
(Anderson S Bower, 1974) . This point has often been missed, sometimes result- 
ing in the construction of decision analytic models proposed for interfacing 

directly with the environment (Howard, 1966) , despite the realization that 

subjective judgments are involved right down the line (Stael von Holstein, 1977) 

Decision theory does not in itself provide any model of semantic inputs , 
or of the environment, so in each case inputs cross an interface from a system 
not formally modeled to one that is. Hence, the total system cannot be closed, 
and the decision- theoretic model must be conceived as part of an open system 
in which elicitation instructions are sent as outputs across the interface re- 
questing the necessary information to proceed with modeling the decision 
problem. 

Three different types of information are required for input with the 
decision- theoretic model : 

1. Information about influences of acts on events, and vice versa; 

2. Information about probabilities to be assigned at event nodes; and 

3. Information about utilities' of consequences. 

Because the system on the other side of the interface is not formally modeled, 
no axiomatic way of specifying the form of the output (elicitation instruction) 
will guarantee that the input subsequently received is that required at that 
point In the generation of the decision- theoretic system. Hence any input 
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Not explicitly 
modeled within 
decision theory 




Not explicitly 
modeled in 
decision theory 



Semantic memory (Decision maker's cognitive 
information processing system contains models 
of the environment and goal structure.) 



Interface with 
system explicitly 
modeled within 
decision theory 



///A//\ 
/// 
/// 



/// 
/// 



information about influences 
of acts on events, and vice veisa 



y///////// /////////////////////////// /////// 



event-act linkage 
(e.g., decision tree) 



// 
// 
// 



hatched line is boundary 
of the province of 
decision theory 



Figure 1. inputs and outputs involved in interfacing a decision theoretic 
event-act linkage to a "real world" problem. 



such as, "the decision analysts should take on a role not too dissimlar „o 
that of a psychoanalyst" (Brown, Kahr : , & Peterson, 1974). 

Despite the fact that optimal elicitation instruction .cannot be specif ied 
axiomatically, some forms of elicitation instruction will be more efficient 

I" subsequent sections of this report we will develop | produc- 
tion Sstern'r^reSfntation of heuristics Resigned to optimize .such J -lency. 

First though we will describe revisions and extensions of the decision 

Seoretlc sys^: shown in Figure 1 resulting from research -^f^ i^rf ace 
the past two decades, that were, in effect, designed to push back the interface 
btrwlen act-event linkage system and the decisionmaker's semantic memory 
through buffering the system with three further systems. 



relationships; input information about prooaDiii^ie* « ■ =f=v— - — r-r- 
(unKmensional) scalar numbers assignable to consequences in a one-to-one re 
tst-tonshiD Eliciting these various inputs in applied problems has not always 
ilen easy so decision analysts have developed systems, specified axiomatically 
witnin Vision theory, designed to buffer these inputs general specifica- 
tion of each of these three buffer systems is considered below. 

Buffering Act-Event Linkages: Th e Inf lue^^c^-Diaaran 

The basic decision-theoretic model of Figure 1 assumes that the decision 

eliSt such linkages, decision analysts often received the nonbmary input, 

"it depends." Selvidge (1975, p. 46) gives an example: 

Suppose someone were to ask you whether_or not you will^buy a new car 
next year. You might answer that it depends on the state of repair 
of your old car. At the present you do not know what ^ outcome of 
this secondary 3 event "state of repair of your Old car will be .... 

What can the decision analyst do about this? Selvidge continues: 

but you can list the different outcomes and then for each of these 
assess the probabilities that you would or would not buy a new car 
under those circumstances. 



•„„, ■•secondary," risa "not e^licitly moailia vithin ths ict-ivent tree. 
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Selvidge then shows how such information . can be structured through the 
use of an influence diagram, modeling an act (or event) whose occurrence is 
conditioned by a number of secondary events and defines the composition rule 
appropriate for use within the influence diagram structure. 4 

The core system describes linkages between acts and event! leading to 
consequences, influence diagrams, in effect, act as a buffer for this core 
system, enabling the modeling of secondary events that influence the assess- 
ments to be made within the system. • ., ■■ 



Buffering Utility Assessment: Multiattribute Utility 

When the value of a consequence can be completely described in terms of 
money (e.g., worth $1,00.0), utility assessment may be reasonably conceived as 
mapping a unidimensional utility function on to- monetary value. The scalar 
monetary value is then transformed into a scalar utility value, which is input 
to the basic decision-theoretic model. However, many consequences possess 
moderately or extremely complex value structures (e.g., "have a child, 
Beach et al., 1976). Attempts to elicit scalar holistic utility assessments 
of such consequences directly from decision -makers are usually unsuccessful. 
The decision maker typically responds to the elicitation instruction with the 
reply that "there are too many factors to trade off." Early attempts to solve 
this problem were based on elaborating the act-event tree into the future, look- 
ing for subsequent consequences that would possess a simpler value structare 
and that would therefore facilitate direct scalar assessment of their utilities. 
However, there is no guarantee that such an elaboration will u. cover consequences 
with simpler value structure, and the elaboration has the additional undesirable 
effect of pushing the decision horizon further into the future, a future that 
exists only as a fantasy in the decision maker's mind and that may, at the time 
an immediate act has to be considered, not be modelabie with any precision 
(Brown,. 1979; Humphreys, 1979). 

An alternative, and usually more efficient, solution is to stay with con- 
sequences possessing complex value structures in the act-event tree but to 
buffer the inputs representing utility assessments of these consequences using 
MAUT to provide a further decomposition of their value structures (Raif fa, 
1969; von Winterfeldt S Fischer, 1975; Humphreys, 1977). 

The structure of this decomposition may be modeled in either normal form 
or extensive form. In normal form decompositions, the structure of each con- 
sequence is decomposed into part worths (Kneppreth, Gustafson, Leifer, £ 
Johnson, 1974) on a number of attribute" dimensions . For example, the conse- 
quence of building a particular type of rapid transit system may be decomposed 
into travel time, user comfort, vehicle construction cost, user fatal^ies, 
level of environmental noise, etc. (Raif fa, 1969). The input to the MAUT sys- 
tem is vectors of part worth (decomposed utility) assessments from the decision 
maker (or expert) , and a MAUT-axiomatized composition rule is applied to these 



4 For a specification of computer-assisted procedures for use in such modeling, 
see Allen et al., 1976. 
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vectors to yield the holistic utility values for consequences (Humphreys, 
1977) . These scalar values are the output of the MAUT system and the input 
to the act-event system with which it is interfaced , 



In extensive form decompositions, a utility hierarchy is constructed, 
in which the holistic utility of each consequence is decomposed within a tree 
structure (here called a hierarchy) , At the bottom level of the hierarchy the t 
decomposed part worth assessments are input, the same inputs required by . a 
normal form decomposition. However, the composition of these inputs into 
holistic, scalar utilities of consequences (emerging at the top' of _ the hierar- 
chy) is performed in stages, by, multiplying through the -hierarchy (equivalent 
to folding back a decision tree), permitting the examination of partially de- 
composed utilities of consequences . in addition to the fully decomposed input 
assessments and holistic utilities- Examples of the use and interpretation 
of such hierarchical representations of the utility structure of consequences 
are given in Beach, Townes, Campbell, and Keating (1976); Chinnis, Kelly, Mirik- 
ier, and O'Connor (1975); . and' Fischer , Edwards, and Kelly (1978) . In addition, 
^ e interactive multi attribute utility decomposition i and re i compos ition decision 
aid, MAUD, computes and uses a hierarchical utility structure to aid in elicit- 
ing weights oh the various attribute ^imens ions , 

All of these systems buffer the act-event structure. They do this by 
moving the site of the utility interface with semantic memory, so that the 
relevant elicitation instructions are designed to elicit inputs representing 
decomposed utilities of consequences on attribute dimensions, rather than 
holistic utilities. 

Buffering Probability Assessment: PIP (Probabilistic Information Processing 
Systems^ 

The information about probabilities to be assigned to event^ nodes, which 
is required as input to the act-event system shown in Figure 1, is of the 
form of the probability of a hypothesis given particular data: P(H|D), 

The hypothesis (H) is that the future event represented_at a particular 
event node in the decision tree will occur. The data (D) summarize the infor- 
mation, not shown on the tree, relevant to the event and given the intervening 
scenario represented by the linkage within the decision tree connecting that 
event to the present situation _ (immediate act), Edwards _U_962) and Pitz ; (1975) , 
among many others, have pointed but that estimates of the required P(h|d) are 
often not readily available and have to be constructed" by integrating P_(d|h) 
over a variety of data and hypotheses. For example, consider the hypothesized 
event, "enemy launches attack." One must estimate P(h|e»: the probability 
that this event will happen,, given D, the state of affairs at that future 
point in time at which the decision maker believes the hypothesized event may 
occur. Faced with the need to estimate this, the decision maker usually starts 
considering data defined in terms of P(d|h): What is the probability associated 
with particular states of the world given that the enemy actually launches an 
actack? With a complex world, a large number of P(D|H)s exist; hence a wide 
range of data may have to be considered and integrated in the attempt to obtain 
a reasonably well-defined assessment of P(h|d), 
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Pitz (1975) outlines methods by which a person may do this within the 
structure of his or her own semantic memory . For ah appropriate model of c 
semantic memory, Pitz used that of Anderson and Bower (i973) , a precursor 
of systems developed by Anderson (1976) , which are discussed, in Appendix A. 
For our purposes we need only to note that such, procedures almost invariably 
produce suboptimal re suits ^ often grossly so, when compared with those readily 
obtainable through. the use of E ayes 1 theorem to perform the integration, within 
what Edwards (1962) called a Probabilistic Information Processing (PIP) system. 
Edwards' definition of a PIP system is outlined in Figure 2. 

The input to the PIP system (elicitatioh instruction) a cross the inter- 
face from the; decision-making system is a request for information about tne. 
likelihood of an event" (H?) and data about the states of the wrid obtaining - 
at the relevant (future) time, D. The output returned across this interface ^ 
is P(h|d) , which becomes an input to the act-event system. In order to obtain 
P(h|d), the PIP system requires estimates of P(d|h) over all Hs and Ds rele- 
vant in establishing P(d|h). These are elicited either from decision makers, 
(or experts) or from formal (computer-based) models of the environment by ask- 
ing them to consider the probability of the data if H were to obtain. Memory 
is involved, because the data that need to be considered are almost certainly 
not those impinging at the present moment on the decision maker 1 s senses, or 
the machinery implementing the formal model's sensors, but have to be recalled 
from earlier experience , yielding data believed' to be relevant in establishing - 
the state of the world, D, under consideration. 

Hence," use of a PIP system serves to buffer inputs concerning uncertainty 
about future states of the world to the act-event system. PIP systems were 
originally proposed as labor-saving devices for cases where P (H | D) was not 
directly estimatable, providing Bayes' theorem as an. automated composition 
rule. However, the superiority of Bayes 1 theorem over intuitive composition 
rules for integrating P(d|h) s to obtain P(h|d) was soon confirmed in a wide 
variety of contexts (Edwards & Phillips, 1964; Edwards, Phillips, Hays, & 
Goodman, 1968; Howell, 1967; Gustafson, 1969), and led to the suggestion 
that such buffering should be included in decision-aiding systems where 
possible (Slovic & Lichtenstein, 1911). The Rayeslan composition rules for 
use in PIP systems were originally formulated for normal form operation, that 
is, where the composition of the input information into P(h|d) is accomplished 
in' a single stage. Extensive form representations were developed later, for 
use where the composition is accomplished through intermediate stages within 
a hierarchical tree structure (Kelly & Barclay, 1973). This technique , known 
as cascaded inference , has been found useful in situations in which it is 
possible to decompose the problem of estimating P(h|d) through the use of 
intermediate or explanatory variables-, i.e., where 

it- will often be possible to assess the likelihood of the data 
given some intermediate variable, and "the likelihood of that inter- 
mediate variable given another, and so on, until the hypotheses of 
interest are reached. (Kelly £ Barclay, 1973, p- 388) 

Schum and Kelly (1973) have also developed cascaded inference composition 
schemes for determining the inferential impact of confusing and conflicting re- 
ports from a mixture of unreliable sources, where these reports provide data 
diagnostic with respect to a particular P(h|d> under consideration. ^ 
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From the point of view of this report > all such systems , whether expressed 
in extensive or normal form> extend the province of decision ; theory in the same 
Way: by providing a subsystem to buffer the inputs concerning probabilities 
to be assigned to events within the structure of the core act-event system. 

3.2 Consequences of Extending the Province of Decision Theory 

The developments described in section 3.1 serve effectively to extend the 
province of decision theory by buffering all three interfaces', of the core act- 
event system of decision theory through subsystems involving the decomposition 
of the relevant inputs. The inputs of the subsystem are still interfaced with 
the decision maker's semantic memory, just as were originally the inputs of / 
the stand-alone act-event system. 2 However, the decomposed information now 
obtained through these inputs {part-worth assessments, P(D |h) assessments, and 
influence relations between primary and secondary events): are integrated into^ 
the relevant utility, probability, and event inputs to the core system by com- 
position rules applied within the subsystems. Figure 3 summarizes these 
relationships. 



s 



The province of decision theory has thus been extended to include four 
_ubsys terns within the total system bounded by the hatched line shown in Figure 
3. Each subsystem is constructed on the basis of decision- theoretic axioms 
and is (or should be) coherent and explicitly specified in a way consistent 
with these axioms. The nature of transactions between each subsystem and the 
core act-event system is also completely explicit, because the effect on the 
relevant input to the core system of modification of content or structure 
within any buffer subsystem is completely and exhaustively specifiable on the 
basis of the relevant decision-theoretic axioms. However, this specificity 
is not true for transactions that cross the interface between any of the three 
subsystems and semantic memory, because only one side of the interface is ex- 
plicitly modeled within decision theory. We are not able to say precisely 
what effect a particular modification of content or structure within semantic 
memory will have on the resulting input from memory to a particular decision- 
theoretic subsystem (or vice versa) , because any precise specification of a 
person's semantic memory structure is, of necessity, missing. b Nevertheless, 
wh^e. there is no axiomatic way of specifying transactions across the interface 



5 The pip systems were also proposed for direct interfacing to formal models of 
the environment, as shown in Figure 2. Here we are concerned with decision- 
making situations in which no such fully structured formal model of the environ- 
ment is available a priori, and in which the structuring task facing the deci- 
sion analyst involves what Humphreys (1979) called internal ordering and reorder- 
ing (as opposed to external ordering through the use of a formal model). In such 
cases the interface of the decision-making system is always with the decision 
maker's (or expert's) semantic memory. 

6 Formal models of semantic memory (e.g., Anderson & Bower, 1973; Kintsch, 1974; 
Norman, Rummelhart, S CNR Research Group, 1975; Anderson, 1976) provide precise 
specifications of systems which are incomplete and fragmented approximations to 
semantic memory structure, intended for investigative purposes only. 
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with semantic memory, this paper advances the thesis in subsequent sections 
that heuristic devices have a major role to play in ?P?_ iItl ? z 5 n 9 such trans- 
actions to meet the demands of the decision-theoretic system. " 



4. HEURISTIC DEVICES 



Overview 

Z . . ' - 
Heuristic devices by definition are suboptimal when compared with norma- 
tive formulations for the same operations. Working within a normative frame- 
work, the only justification for the use of heuristics (and resulting risk of 
inefficient use of information or incoherence of rhe material 'generated) is 
that they are n quick and easy" 'or "reduce information processing load" and 
hence generate results that would hot otherwise be available because the 
decision maker would refuse to invest the amount of time or effort involved 
in following a normative iy acceptable procedure. In this report, we are not 
interested in pursuing such a line of justification; 7 rather, we are concerned 
with conditions in which it is not possible to specify a procedure on a norma- 
tive basis, leaving no option but to resort to a heuristic device. This occurs 
only in situations in which the procedure involves crossing an interface be- 
tween a system that is explicitly modeled and one that is not. The only 

interfaces that meet this specification in Figure 3 are the three between the 
decision theory , subsystems and memory. 

For exampTe , one of these interfaces is crossed when a set of criteria 
is elicited from the decision maker for purposes of assessing the utilities , 
of consequences, within the utility buffering system shown in Figure 3. Given 
that it is not possible to specify the procedure to be used here in normative 
terms, what happens in practice? According to Humphreys (1979) , 

Practitioners forced to think about the problem have tended to draw 
on analogies with problems facing psychoanalysts • and clinical psy- 
chologists. Brown, Kahr- and Peterson (1974) suggested that the 
decision analyst take on a role "not too dissimilar to that of a 
- psychoanalyst," although such a suggestion, taken seriously might 
involve more than they had bargained for (c.f w Sandler, Dare & 
Holder, 1973) . Keeney (1975) described a MAU decomposition used in 
studying alternative energy policies by presenting the verbatim ; 
record of a session with the decision maker in case report format. 
Humphreys and Humphreys (1975) suggested the use of elicitation tech- 
niques designed, for use within repertory grid technique, which was 
originally developed at Harvard psychological clinic (Kelly, 1955) . 
None of these techniques, of course,, are grounded in any axiomatic 
theory of preferences. They are_all able to elicit structural mate- 
c rial that would not have been volunteered without their use, and it 



? Por an example of a comprehensive attempt of such justification of particular 
heuristic procedures enclosed within a decision- theoretic framework, see 
Wallsten (1978) . 
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is possible to check coherence Of the structures so generated. 
However, there is no guarantee that the resulting coherent struc- 
tures are in any way optimal. 

Humphreys (1979) discusses the need for internal reorder'ings of prefer- 
ence structures generated through the use of heuristic techniques to brxng 
them closer to optimality while maintaining coherence. Section 5 descries 
the structuring (and restructuring) capability of the computer program MAUD, 
whose operation is controlled through the operation of a production system, 
section 4.1 provides an outline introduction to the notion of a production 
system and the potential uses of such systems within decision-theoretic 
contexts. 



4.1 a Production System Representation 

Since Emile Post's pioneering work (Post, 1943) on a powerful, new symbol 
manipulation system-which he called a production system-- several authors have 
developed Post's idea as a basis for the specification of psychological models 
of human knowledge. 3 

One of these authois, Newell (1973), explains the basic operations of 
production systems as follows: 

A oroduction system is a scheme for specifying an information process- 
ing system. It consists of a set of productions, each production con- 
silting of a condition and an action.... ^production system starting 

" with an initially given set of data structures, operates as follows. 
..That production whose condition is true of the current data (assume 
there is only one): is executed, that is, the action is taken- The 
result is to modify the current data structures. This leads in the 
next instant to another (possibly the same) production being executed, 

•. leading to still further modification. So it goes, action afterac- 
tion being taken to carry out an entire program of processing, . each 
evoked by its condition becoming true of the momentarily current 
collection of data structures. 

The advantage of production system representations of information process 
iiK, systems is their great generality and flexibility. As Newell and Simon 
(1972, p. 835-6) report: 

Methods are to be represented as production systems, and the set of 
all methods is equivalent to the set of all production systems that 
will realise rational courses of action for some given goals and 
some environment. A specific problem solver has available some 
repertory of such methods, which come to control his behaviour 
unde-" various conditions . 



8 fpr a general review of the use of production systems, see Davis and King 
(1975) . : . " : * 
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A number of authors have taken up Newell and. Simon 1 s suggestion of the 
application of production systems to problem- solving tasks and have generated 
models of the productions implemented within a person's internal judgmental 
or semantic memory system. The best articulated model is that of Anderson 
(1976) f which is reviewed in Appendix A. However, the only application 
within 'a decision-theoretic context is that of Pitz (1979) ji who describes 
how production systems can be used to generate inferences made by subjects 
through testing conditions of representativeness (Tver sky & kahneman, 1974) . 

1 _ . < -a . . . ." ... Q . _ 

The general form of a production rule^ is 

R : {c-a} 

where c is a list of conditions that may be met, and a is a list of actions 
•to be. >. taken consequent on c being met. In generating a production system/ 
Pitz was primarily interested in providing ah account of how his subjects 
might use such rules in o^ e ?5 n ? and noting the contents of their . semantic 
memories to arrive at inferences. However, in this paper we are primarily, 
interested in how to develop such systems for use in directing - and controlling 
decision aids in interaction with decision makers. 

* VThat would such decision aids be like? They would, at the very least, 
possess the following features: 

1. They would give elicitatiori instructions to activate (but not con- 
trol) the decision maker's semantic memory and to elicit specific 
outputs ; 

2. They would check for coherence within the material thus output 
across the interface to a decision-theoretic subsystem (explicitly 
modeled in the decision :aid) and take whatever action is necessary 
should such checks fail. 

* 4.2 A- Critique of Heuristics as Biases 

The study of the use of heuristics within decision-making contexts has 
traditionally been linked with the study of- bias in human information process- 
ing. Attribution of bias is possible only in situations in which it is pos- 
sible to compute what an unbiased response (inference) might be. _The require- 
ments for such situations are outlined in Figure 4. The degree of bias is 

computed by comparing the output of the ihtuitive model being used by the sub- 
ject (persdh suspected of being biased) with the output of a formal model 
axiomaticaaiy grounded within decision theory (e.g., Bayes' theorem) when both 
are supplied with identical input data. The larger the difference, the greater 



9 In section 4 we use the notation P : {c-*A> in preference to R : {c+a} to 
show (i) that the Rule (R) is a production rule (P) and that C and A are 
vectors . 



specified data generating process • 
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bias in human information processing* 
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the bias. In an attempt to insure that ; the input to the two models is identi- 
cal, the data-generating process has to be precisely specified. 10 

The intuitive model employed by the subject is presumed to comprise a num- 
ber of heuristic procedures, and the degree of suboptiinaiity of such heuristics 
is indexed by the degree of computed bias, that is, the- degree of deviation 
from the optimal results prescribed by the output of the formal model. 

Two aspects common to treatments of heuristics as biases are irrelevant 
to the issues addressed by this paper. These are v 

1, The construction of a precisely specified data-generating process. 
We are interested in situations in which much of the data has to be 
retrieved from .the decision maker 1 s semantic memory (see earlier 
section) , and in which there is no precise external specification of 
the structure of the processes involved in the generation of such 
data. 

2. The comparison with a formal model axiomaticaliy based in decision 
theory. In the specification and implementation of decision aids, 
we assume that where such models exist, and where the intuitive 
models used by (unaided) decision makers yield output that is sub- 
optimal compare.d with that provided by the formal model, then the 
decision aid will . implement the formal model in preference to the 
intuitive "model, 11 and consequently, the resulting judgment will 
be "unbiased." 

As described in section 2, what we are interested in is the use of heu- 
ristics at sites in which no formal model can be axiomaticaliy specified, and 
in which, therefore, the issue of suboptimality cannot be investigated by a 
direct. test agairfst a formal criterion. We will have to address the question 
of optimal ity among heuristics, not optimality of heuristics. 

However, the first step in such an investigation is to assemble a set of 
heuristics that can serve as candidates in our investigation of problem struc- 
turing and that may therefore merit incorporation within decision aids. The 
criterion for including a heuristic in this set is that it must be sited at 
the interface between a decision-theoretic subsystem and semantic memory (see . 
Figure 3) . . 



A typical specification is as fallows: "Chips drawn at random, with replace- 
ment from two bags, each containing a -large number of chips, but with a*defined 
composition of chips, such as 70% red and 30% blue, or 30% red and 70% blue in 
each bag"; see Phillips and Edwards (1966). 

11 This rationale for decision_aids is called, "bootstrapping" (Dawes & Corrigan, 
1974); see also Humphreys, 1977 (section 6.1), and Humphreys, 1979 (section 3). 
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in section 4.3 we present a case study of the investigation of two 
processes purported to underlie the reported conservatism bias in proba 
tic information processing, 12 misaggregation and misperception. The case 
study details the isolation of the heuristics .involved in these accounts of 
bias arid demonstrates how they may be rejected from our set of candidate heu 
ristics because they are not cited at the required interface. 

in the literature, consistent deviations from the output of an appropri- 
ate formal model are often attributed to a global causalmechanism such as 
"availability" or "representativeness" (Tversky s Kahneman, 1974). .In such 
cases, we found that a reformulation Of the postulated processes. using a pro- 
duction system representation, like that discussed in section vas a 
necessary step in isolating the actual heuristic procedures involved prior to 
examining their 'site of operation. 

In section 4.4 we present a reformulation of Tversky and Kahneman 's ; 
account of representativeness in these terms. 

Section 4:5 summarizes the results of our formulations of the existing 
literature and provides a classification of heuristics along the following 
lines : 

~ 1. Effects of heuristics upon intuitive judgments, as reported in the 
literature; 

2. Explanation suggested by the authors reporting the effect; and 

3. A statement or Which of these explanations of heuristic effects we 
intend to investigate further for use within decision-aiding systems 
employing structuring heuristics, and our reasons for doing so. . 



Conservatism, 
Dn? 

Conservatism in intuitive probabilistic judgment was described by Slovic 
and Li'chtenstein (1971) as follows: 

Upon receipt of hew information, subjects revise their posterior- 
probability estimates in the same direction as the optimal model 
but the revision is typically too small: subjects act as if the 
data are less diagnostic than they truly are. 

These conservative responses are commonly accounted for by one of two explana- 
SSnt- as the result of either intuitive misperception of the data generator _ 
(SbnUristein % FeSey, 1968; Peterson, DuCharme, .Edwards, 1968; .Pitz « Downing 
1967 Wheeler I Beach! 1968; Vlek s Beintema, 1967) or disaggregation of various 
Pieces of information to produce a single holistic response (DuCharme & Peterson, 
?967- Peterson I Swensson, 1968; Hammond, Kelley, Schneider, fi Vancini, 1967). 

12 For research establishing this bias, see, for example, Peterson, Schneider, 
and HiSS mm , Phillips and Edwards (1966), and Pitz and Downing (1967). ^ 
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The misjperceptibri thesis is explained by Slbvic arid Lichtensteiri (1971) 
in the following way: 

In order to perform optimally subjects must have some understanding 
of the data generator, the model, device, equation, or assumptions 
used by the experimenter to generate the stimuli shown to the subject. 
If the subject misunderstands the data generator he may misperceive 
the conditional probability of the data given the hypothesis, P(d|hJ. 

In the laboratory experiments commonly used to support the misperception 
thesis - t the' true nature of the data generator (such as a particular type of 
probability distribution) isspecifiable precisely because the experimenter 
generates the stimuli shown to the subject from well-specified sources' such 
as 'that described in footnote 10. In real world contexts, it is difficult to 
specify the true nature of the data generator, because in such real world 
cases it is notoriously difficult, if not impossible^ to specify a veridicul^ 
model of the task environment with which intuitive models can be contrasted. _ 
Misperception becomes a misnomer when veridical perception cannot be specified, 
but the explanation may still be of interest because it indicates a feature of 
methods used to model stimuli within the individual's information processing 
apparatus . 

But where is this feature located within the system shown in Figure 1? 

It is neither a feature of the assessment of content within decision structure 
(although it may lead to biased judgments) nor of a structuring heuristic used 
to access information from semantic memory for input into the decision struc- 
ture • Rather, it is a feature of subjective encoding of information given in 
the environment within the network of semantic memory. It thus operates at 
the interface between the environment arid semantic memory, and not at the 
interface between semantic memory arid decision- theoretic subsystems, which is 
of concern to us here. Hence we can reject misperception as_a structuring 
heuristic useful within our terms, because it is not situated, at the appropri- 
ate interface in Figure 2. . 

On the other hand, the misaggregation thesis of information processing 
interprets conservatism as the result of Sntuitive inadequacy in information 
aggregation when compared to the procedures for aggregation prescribed by the 
Bayesian method. On this explanation, therefore, conservatism is the conse- 
quence of a feature of intuitive assessment of information within the probabil- 
ity buffering subsystem shown in Figure 3 and is thus of no help to us in 
specifying ways in which subjects structure the decision space itself, because 
once again it is not situated at the appropriate interface; 

In summary, while both the notions of misaggregation and misperception 
lead to the specification of heuristics, these heuristics did riot meet the 
criteria for inclusion in the. set of heuristics that might be useful in deci- 
•sion structuring operations, because they were not sited at the appropriate 
interface. The next section, however, describes the isolation of a heuristic 



13 See quote from Newell and Simon in section 4.4 to understand why this is 
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which, although conceived within an account of bias in information processing, 
is located at the appropriate interface and has already been reported elsewhere 
in use as a decision-structuring heuristic (Sheppard, 1976; Humphreys, 1979, 
section 5 ; 2) . 

4 .4 Heuristics Within Production Systems: 
Analysis of Repre sentativeness 

This section presents in some detail a production system representation 
of one heuristic, described by Tversky and Kahnemari (1974), which we believe 
is a component in intuitive structuring of cert a in_kinds of decision problems. 
Tversky and Kahneman named it the "representativeness" heuristic We delve 
fairly deeply 'into the modeling of this example to give a detailed demonstra 
tion of a production' system representation of a structuring heuristic The 
subsequent sections of this paper (and our work emanating from it) will be 
centered on the implications of structuring heuristics, rather than their de 
tailed modeling, first, though, we detail the modeling to clarify the function 
of structuring heuristics and to show the advantages of their specification as 
production systems- 

The effects accredited to the use of the representativeness heuristic 
have been shown to bias intuitive judgment considerably and to be highly 
replied "ersky and Kahneman (1974, p. 1124) have introduced it as follows: 

Many of the probabilistic questions with which people are concerned 
belong to one of the following types: What. is the probability that 
object A belongs to Class B? -What is the probability that event ft 
originates from class B? What is the probability that process B 
will generate event A? 

in answering such questions, people typically rely on the representa- 
tiveness heuristic, in which probabilities are evaluated by the degree 
to which A is representative of B, that is by the degree to which A 
resembles B . For example, when A is highly representative of B the 
probability that A originates from B is judged to be high On the 
other hand if A is not similar to B, the probability that A originates 



from B is low. 

A 



A consequence of evaluation by representativeness is. that ?.f people 
evaluate probability by representativeness, therefore, prior probabilities 
will Be neglected" (Tversky s Kahneman, 1974, p. 1124). Tversky and Kahneman 
Z Xl 2«!S this effect in a variety of experiments, one of which is examined 
nere fn detaii In this experimen/subjects were asked to judge the likelihood 
Sat an individual, call him Dick, is either a lawyer or an engineer. Subjects 
were given two sets of data from which to make their judgment: 

1. Base-rate data: lawyers and engineers are in a ratio of 7:3 in 

the population in question'. 

2 Case data: a brief personality sketch so that the subject may 
' perceive a similarity between Dick's described traits and the 
stereotype of a lawyer or engineer. 
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From' the results, a consistent pattern emerged of sub3ects placing much 
greater evidential weight on the case data than on base-rate data i. Judgments 
were typically resistant to changes, in the ratio of lawyers to engineers in 
the population, and subjects typically ignored base-rate data even when the 
case data description was modified so as to become totally uriihf brmative . 

The explanation offered for this judgment bias by Tversky and Kahneman 
(1974, p. 1125) is that "subjects evaluated the likelihood that a particular 
description belonged to an engineer rather than to a lawyer by the degree to 
which this description was representative of the two stereotypes, with little 
or rib regard for the prior probabilities of the categories." 

This explanation can be placed in context through the use of a model of 
sequential processes involved in probabilistic inference first presented in 
Phillips and Wright (1977) . This model is reproduced as Figure 5. According 
to the Phillips and Wright model f the use of probabilistic information in a 
judgmental task requires a considerable elaboration of the problem over a 
simple deterministic .assessment and involves the prior rejection of two other 
possible response modes as inappropriate : a response under certainty at 
stage 1 of the scheme shown in Figure 5, and a response consequent on a re- 
fusal to assess probabilistic evidence in spite of uncertainty at stage 2. 

Because subjects in the Tversky and Kahneman experiments were presented 
with data inviting probabilistic inferences and were prepared, quite happily, 
to produce probabilistic responses, these subjects apparently elaborated the 
problem sufficiently to arrive at stage 3 of the Phillips and Wright schema. 
The biases typically found in the inferences made are thus the consequence 
of the particular way in which judges elaborate the structure of the problem 
at stage 3 in the schema. The judgmental problem is, in fact, modeled in a 
fashion that- -leads judges to be selective about which of the available proba- 
bilistic information they incorporate in the structure they use as a basis 
for their inferences. 

A 

Tversky and Kahneman* s results indicate that subjects given case data 
perceived as being similar to (or .representative of] l a stereotyped class, at 
block 2 in Figure 6, typically made their judgment on the basis of the degree- 
of-fit between the case data and the characteristics of the stereotypes, ne- 
glecting base-rate data. Such judgments based on representativeness are repre 
sented in Figure 6 as those routes through the diagram marked by double -lines. 
Thus, the representativeness heuristic is characterized by two features: 

1, Using a particular search instruction within semantic memory ("fit 
these data to the characteristics of a known class") , and 

2. Making a probabilistic • judgment on the basis of the degree of this 
fit without reference to any other available data. 

It is the latter of these alone that violates the axiomatic model in. fail 
ing to combine prior and posterior probabilities. Adherence to the axiomatic 
model would involve redrawing Figure 6 so that it became possible for a .judge 
to move through both steps 2 and 3^ In fact, judges given use_ful case data 

typically take the route passing through steps 1, 2, and 6 and so on (as a 

result of the representativeness heuristic). Judges given worthless case data 
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Response : 
. I - Yes/no 
^\ (i« P - 0 or 1) 



Problem requires 
further elaboration 




ribhpr obabilistic - 



Response : 
Don't know or 

Chance 

probabil ity 



Problem requires 
further (probabilistic) 
elaboration 




Discrimination of 
probabilistic data 



degree 



Response : 
verbal phrases 
. including prob~ 
"►\ abilities lying 
between 0 and lj 



Notes . 



Stage 1, 



Stage 2 . 



Stage 3, 



Judge's decision here is decided by a variety of factors classified 
under (a) cultural variables, (b) psychological variables, and 
(c) task variables. 



Judge's decision here is 
cultural variables and psychological variables (expecially those 



also decided by factors classified under 
ychological Variables (expeci; 
relating to open/closed mindedness; see. Rokeach, I960) 

This further decomposition of the basis for the inference involves 
the subjective elaboration of the structures represented in event 
and/or probability buffer systems shown in Figure 3. 



Figure 5. 



Model of the cognitive processes involved in 
inference (developed from Wright s Phillips, 1977) 
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(data that permit little or no association with any already, encoded class con- 
cept) persist in neglecting base-rate data and choose to take the route through 
steps. 1, 2, and 4. Only sub Ejects given rib case data take account of frequencies, 
and they travel routes 1, 3, and 5; 

It thus can be seen that judgments using case data and those using base- 
rate data involve traversing entirely different routes through the block dia- 
gram, A judgmental procedure involving the. combination of case and base-rate 
data would require a different system from that of Figure 6, one that wculd . 
open up route? to a problem solution quitf* different from those described 
previously: 

We are how in a position to reformulate the problem of jthe representative- 
ness effect and its etiology into the question, Why are judgments such as that 
described above typically structured through the sequential procedures of the 

form shown in Figure 6 rather than in a form permitting the combination of 

base-rate and case data? The following reformulation of the representativeness 
heuristic in production system terms suggests a solution to this question. 

Applying the. R : C A formulation of a production system described in out- 
line in section 4.1 (and in detail in Appendix A) to the structuring principles 
underlying Figure 6, we obtain: 

R- Condition Action 

Active memory contains a Set the probability of this 

class of objects that match t — — object or event being a mem- 

this object or event. — ber of the class in question 

to. match the degree of fit 
between it and the: matching 
class. 

The implementation of this production leads the judge down routes 1, 2, and 6 
and so on, in Figure 6, and thus entails the neglect of base-rate data and 
reliably reproduces the reportec biases in responses (Tversky & Kahneman, 1974) . 
In addition, the way in which memory is accessed in this production indicates 
that the site of the operation of the heuristic is the interface between memory 
and the probability buffering subsystem shown in Figure 3. 

There is, however, a great deal more ro the full specification of a pro- 
duction system than merely suggesting one possible production that such a sys- 
tem might contain. In particular, it is necessary for our purposes to under- 
stand the process whereby some productions pass a selection test and thus be- 
come potentially invokable , whereas others fail. 

According to Anderson (1976, p. 186) production selection consists of 

"quick partial tests to see if the condition, of a production is relevant 

to the current contents of active memory.". A production can be implemented _ 
only if it is appropriate to the contents of active memory, and thus production 
selection is crucially dependent on the current activation of memory. 
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/question Eequirii 9 
[ inference about, a. 
t person called Dick 




Set. probability of _ 
Dick being a lawyer 
or an engineer to the 
frequency of each 
class (5) 




Dick is a ® 
lawyer; less 
confidence 



Dick is a 
lawyer : near 
certainty 



f EXIT ^ (_ EXIT J 



Fiqure 6 Block diagram of Tversky and Kahneman's (1974) 
model of judgment biased by representativeness. 
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We have so far- shown only that if a particular production is implemented, 
then all the judgmental effects associated with representativeness will follow. 
It remains to be shown why this production -is so commonly invoked. Tversky and 
Kahnentan's work on representativeness . contains ho clues as to the determinants 
of its invocation. However, the crucial dependence of production selection, 
upon the currently active memory indicates that the answer lies. in discovering 
the determinants of the particular activation of memory. Newell and Simon 
(1972, p. 849) provide a clue to the answer: 

We can know the objective task— "out there"— only through its partic- 
ular representations. There is no neutral way of describing the task 
environment. As a consequence > task instructions do much more than 
define the task; they provide, < in addition, a specific representation 
of it that can serve to define an initial problem space, and even 
parts of an initial problem solving program for the subject. 

Thus; the repercussions of the subject's heuristic structuring of the . 
task environment are felt throughout the entire judgmental process. One such 
repercussion > we suggest, is on the configuration of activated memory. 

This accords' neatly with our finding in the representativeness case. The 
process traced in' Figure 6 was found, to be the result of invoking the repre- 
sentativeness production.. Any search to discover the basis for the invocation 
of that production leads back through the process of selection of potentially _ 
appropriate productions, and of memory activation > to the issue of the subject 1 
heuristic structuring of the task environment. The whole process,, from initial 
structuring to judgmental -response , represents a highly constrained system, 
each stage of which is partially determined by prior stages. 

What form of heuristic structuring precedes and determines a judgment 
by representativeness? While Tversky and Kahneman do not directly address 
the structuring issue, they havp recently (1977) suggested a link between 
representativeness and the intuitive introduction of causal thinking into the 
judgmental process. This suggestion is, in effect, extended here to show how 
a subject's intuitive modeling of the task environment in causal terms deter- 
mines which productions pass the selection .test and consequently are available 
to be invoked. Which portions of memory a subject activates and in what form 
(in full, extended propositional form or in the. more limited form required for 
matching-by-intersection tests) are determined by the subject's initial struc- 
turing of the task environment.. Introducing a causal model of the task environ 
ment is one form of such initial structuring, and such a model can function as 
the initial memory activator. Abelson's (1976) work on cognitive scripts sup- 
ports the belief in the predominance of this structuring of judgmental problems 
in causal terms: 

Thus, in the example displayed in Figure 6, subjects' judgments of the 
probability of Dick being a lawyer typically involve the initial generation of 
a hypothesis concerning a causal relation between Dick's character traits and 
intentions on the one hand (derived from the personality sketch given) and 
Dick's choice of profession on the other, and this hypothesis creates an _ 
active partition of memory. It is assumed that the portion of memory likely 
to be activated in these circumstances, and hence available for accessing, 
consists of a simple pattern specifying traits and properties typical of 
"lawyer." The subject's judgmental task is now restricted to merely scanning 
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for a match between Dick's character traits derived from the givfen personality 
sketch and the properties associated with "lawyer" thus activated in memory. 

Hence, the production typically implemented not only neglects base rates 
but engenders a fairly loose and imprecise ' assessment of case data. A more 
precise assessment of case data would require a prepositional representation 
Of relevant memory and a closer screening of the probe (that is, the character 
sketch of Dick) to make an exact assessment of the information it contains 
(for instance, encoding all the verbal elements in the proposition, as opposed 
to merely scanning for property words to be matched with properties encoded in 
memory). In short, the specific activation of memory involved in structuring 
the problem according to a causal model determines what information is acces- 
sible; this in turn determines what judgmental procedure is used to generate 
a probabilistic response. Methods based on.Bayes' theorem provide a formal, 
optimal procedure for the combination of information in inference but are of 
necessity silent on how such information is accessed However, in intuitive 
judgment* restrictions of access to information within memory (due to restricted 
active memory) can place crucial restraints on the inferential procedures that 
can be brought to bear. If a certain memory activation does not meet the con- 
dition of a production, that production is rendered inoperable 

The implication for decision analysis of the above interpretation of the 
representativeness Heuristic is that the method of accessing information for 
input' into the decision structure can prevent its optimal use in accordance 
with Bayes- theorem. If an inadequate or inappropriate structuring heuristic 
is emoloved at the interface between memory and the decision-making structure, 
the decision maker runs the risk of placing a structure on the decision 
problem that will of necessity commit him to inappropriate and nonoptimal in- 
ferences and actions, regardless of the optimality of the composition rules 
(Bayes- theorem, SEU, etc.), which He uses. to manipulate information within 
the structure in arriving at His inference, or plan of action. 

Incidentally, it is worth, noting that judgment by .representativeness 
counters prima facie the supposed ubiquity of simplification techniques 
designed to ease cognitive strain (Miller, 1956; Newell & Simon, 1972) in 
intuitive decision making. Since case data, unlike base-rate data, must be 
matched against information retrieved from memory to be put to use in the 
judgmental process, the diminution of cognitive strain thesis would find it 
surmising that base-rate data rather than case data are typically neglected 
The former, it may seem, are more easily put to use, requiring less cognitive 
work on the part of the judge. The material just presented therefore suggests 
that it is misguided to explain the use of the representativeness heuristic in 
inferences as resulting from the need to reduce information processing load. 

t .. _ __' i[ 

14 Sheooard (1976) and Humphreys (1979, section 5.2) present a case study of 
the usf of such a heuristic by a division manager of a medium-large U.K -based 
fi rm in making foreign location decisions and discuss the advantages and 
limitations of such 'an approach. " ----- - ; 
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4.5 Classification of Heuristics 



Table 1 summarizes and classifies the results of published investigations 
into the use of heuristics in intuitive judgment: Column 1 of the table 
specifies the features which, it is believed, are characteristic of intuitive 
judgment. Column 2 lists the explanations given for the presence of these 
features referenced by the authors supporting' these explanations. In columns 
1 and 2 we have used the currently, prevalent nomenclature for the phenomena in 
question. In column 3, however, we have broken down this existing work on 
heuristics into two classes: those that may be relevant to the elicitation 
of structuring heuristics as we have defined the terms , and those that we be- 
lieve are not relevant. We briefly state the basis for doing so in each case. 



5 . AN APPLICATION 



Overview of MAUD 



MAUD, Multiattribute Utility Decomposition, is an interactive, computer- 
based decision aid designed to help decision makers faced with a choice among 
alternatives where the basis for preference lies in differences in worth on a 
number of different attributes possessed in varying degrees by those alterna- 
tives MAUD assists and guides the decision maker in (a) structuring and de- 
composition of such preferences in a a.uiciattributed form and (b) finding out 
the tradeoffs he or she is prepared to make between values on the various at- 
tributes in recomposing these decomposed preferences into. holistic utilities 
to be placed on the alternatives as a basis for choice. An embryonic version 
of MAUD was described by Humphreys and Humphreys (19 7 5) ,..-and_ s j g ^^Bnt^ersions 
have been found to be of use" in situations in which the decision maker has some 



have been found to be of use in situations in wnicn uie — — 

intuitions about relevant aspects of the decision problem but has not, as yet 
been able to discover its precise subjective worth structure. 

MAUD was designed to work in 'direct interaction with the decision maker, 
without a decision analyst, counselor, or other expert as intermediary. How- 
ever since MAUD is limited to the examination of value tradeoffs among mem- 
bers of a homogeneous set of alternatives, a decision analyst or counselor in 
discussing a complex problem facing the decision maker should first arrive at 
an agreed definition of the set of alternatives whose worth structure MAUD is 
to investigate and the goal under which this worth structure is subsumed. 

5.1 Example of the "Us e of a Heuristic Device: 
Use of Structuring Heuristics in the 
Elicitation of Poles of Attribute Dimensions 

Decision theory is of necessity silent concerning the elicitation of at- 
tribute dimensions for incorporation in a decomposed preference structure. 
However, methods . for .eliciting. such, dimensions have been studied in some de- 
tail within research in the field of personality, stemming from the discussion 
bv Kelly (1955) of the repertory grid, a device for conceptual mg an individ- 
ual's dimensional cognitive structure. The rating form version - the reper- 
tory grid (see Bannister S Mair, 1968) is closely related structurally to_the 
normal form decomposition of utilities of terminal events (called elements 
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Table 1 



Classification of Heuristics 



Uncertainty Structure: 

Reported effects in 
intuitive judgment 



(1) Conservatism in prior 
and posterior, proba- 
bilities (DuCHcirme, 
1970, claims conser- 
vative effects only 
at extreme ranges of 
posterior odds) 



{2) Overconf idence 

(a) Neglect of base- rate 
data and failure to 
regress toward the 
mean in prediction _^ rom 
bane rate and case data» 
unless base-rate data 
perceived as causally 
related to outcomes 
(Tver sky & Kahneman, 
1977) 



Explanation suggested by 

authors reporting the effect 



Possible use as a component 
within structuring heuristics 



(1) Subjects misperceive data generator 
(Vlek 6 Beintema, 1967j Slbvic & 
Lichtenstein, 1971) 

(2) Subjects misaggregate information 
(Edwards, 1968; Slovic £ Lichten- 
stein, 1971) 

(3) Subjects tend to assign equal proba- 
bilities to all outcpires unless there 
ts_a. reason to do otherwise (Pitz, 
1975) 



None — locates the effect at the _ interface 
between memory and environment 



None — locates effect within uncertainty 
structure 

None — locates effect within uncertainty 
structure 



(1) Representativeness-- judgment made by 
fitting case to a class of which the 
case is judged to be a representative 
member (Tversky * Kahne_man r ..l?74; 
Kahheman 5 Tversky, 1972, 1973) 

(2) Subjects fail to measure predictive 
validity of data (Kahneman 6 Tversky, 
1978) 



(6) Ovexcohf idence in judg 
merits of degree of fit 
between samples arid popu- 
lations (law of small 
numbers) 



(3) Subjects misunderstand. regress ions 
arid meghs (Peterson. s Beach, 1967; 
Slbvic 6 Lichteristeiri, 1971) 

(1) Representatiyeness--subje judge 

samples by the similari ty to a i model 
or prototypeofpopulatipn (Tversky 
6 Kahrieihah, _I971*_I974; Kahneman & 
Tversky, 1972, 1973) 



In cases in which subjects make inferences by- 
referring case data to a parent population, 
rfepreseritativeriess is used as a search in- 
struction for retrieval of iriformatloh about 
parent population (see text) 

None— gives no indication of cognitive 
strategy used by the subject 



None — gives no i rid i cat ion of cognitive 
strategy used by the subject 



In cases in which, a subject, can_re_tri eye a 
model of the population from, memory, the _ 
probability of a sample matching the. model 
is judged to be highj arid hence confidence 
in the replicabiiity of results is high 



A. * 
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Table 1 — Continued 



Uncertainty Structure (continued) : 



Reported effects in 
intuitive judgment 



Explanation suggested by_ 
authors reporting the effect 



Pos_sible_use as a component 
within structuring heuristics 



Subjects tend to explain consequent 
failures of prediction by causal 
accounts (Tversky & Kahneman^ 1977) 



(2) 



In contexts characterized by lack 
of independent data, small samples 
can be highly representative of 
populations (Einhorn & Hogarth* 
1978) 



((*) Ovrrconf id/»nce in 
profit ct ion from 
inviqined sconnrios 



Avaiiability--highly imaginable future 
developments are available for easy ac- 
cess but are not necessarily highly 
probable (Tversky S, Kahneman, 1973, 1974) 



(3) Judgment from cor^ 
relations betwe/ 
data sets 

(a) Illusory 
correlation 



(1) Subjects perceive causal re latioiv* 
ship between data sets (Tversky 6 
KaHhemah, 1977) 

(2) Subjects retrieval of Information 
affected by availability (Tversky 
& Kahneman, 1974) 



Deviant results explained by searching "model 
of the vSrid" for an intervention by a sepa- 
rate causal chain that causes the deviation 
from expectations. 

None — locates the effect in the environment 



If availability .interpreted as determined by 
the structure of semantic memory, then— 
None-- locates the effect within semantic 
memory 

however, aval lability interpreted as 
determined by t_he_ search_ins true tion across 
the interface with seman ti^ memory, the n-- 
effect is interpreted as a consequence of 
intuitive procedure for easy recall of 
information 



Subjects introduce a causal inodel by which 
the data are explained and correlated 



See entry in <2) (c) # column 3 
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Table 1 — Continued 



Uncertainty Structure (continued) : 

Reported In 
intuitive judgment'' 



Explanation suggested by 
authors reporting the effect 



Possible use as a component 
within structuring heuristics 



(b) In correlation 
between input and 
output var i ab 1 es , 
judgment on basis of 
Only 1 cell in a 2 x 2 
data matrix 



(1) Information from other cells often 
unavailable (Ei.nhorri s Hogarth, 
197BJ : ! 

(2) Subjects lack an abstract notion of 
contingency (Smedslund, 1963) 



None — locates the effect in the environment 



None — gives no indication of cognitive 
strategy used by the subject 



(4) Greater redundancy of 
data - 



• qreater con- 
f idonce in inference 
from data (illusion of 
validity) 



"Confidence is high when the data can be 
incorporated into a single integrated 
model that explains them M — causal 
* schemata (Kahneman, 1974) 



Data are. associated with a causal _ model 

which \ it is believed, causally determines 
the data 



(5) 



The confidence that 
suhiects have in their 
prediction depends 
primarily on the qual-_ 
tty of match between the 
selected outcome and the 
i nput . 



Subjects select outcomes by the degree 
of their representativeness to the input 
(Tversky & Kahneman, 1974; Kahneman & 
Tversky, 1972, 1973) 



This suggests. an intuitive iudgmental rule — _ 
select the outcome most representative of 
the input data, and a procedure for elicit-, 
ing outcomes — access only outcomes representa- 
tive of inp^t data. The latter is of interest 
to us; the former is not (see Pitz, 1975,. 
1977) j ' 



(6) Inadequate adjustment 
of a probability esti- 
mate in the light of 
new information 



Original judgment operates as an anchor, - 
and ad j us tme n t from the a ncho r is typ i - 
cally insufficient (Slovic, 1972; Slovic, 
Fischhof f 5 ntchtenstein, 1976) 



None — locates the effect within the 
uncertainty structure 

> - - 

None — effect merely contrasts with Bayesian 
revision in uncertainty structure 



(7) Relative invulnerability 
of opinions to conflict- 
ing evidence (the iner- 
tia effect) 



Strong commitment to an hypothesis 
(Geller 6 Pitz, 1968; Slovic 6 
Lichtenstein, 1971) 



ay 



ERIC 



Table 1 — Continued 



Uncertainty Structure (continued) : 



Reported effects in 
intuitive judgment 



(8) targe deviations from 
mean of a probability 
distribution not weighted 
heavily i Peterson & 
Beach, 1967) 

(9) -In assessment of pre- 
dictive accuracy fc sub- 
jects typically fait 
to learn from past 
failures of predictions 



(10) fJreater confidence in 
prediction of variable 
B_ given variable A than 
vic*» versa, _ when _A and 
B are equally informative 



(It) Subjects' recall_of_fre- 
quencies of events and 
sizes of populations 
typically biased by 
salience and recency 



Explanation suggested by 

authors reporting the effect 



Possible use as a component 
within structuring heuristics 



Subjects misperceive the impact of rare 
events (Slovic 6 Lichtenstein, 1971) 



None — locates the effect within the 
uncertainty structure 



(1) 



12J 



Hindsight bxas — subjects tend to 
overestimate the accuracy of past 
predictions (Fischhoff & Beyth, 
1975) 

Nohirideperiderice of outcomes _due to 
treatment effects: poor judgment 
is vindicated by events (Eirihbrri £ 
Hogarth, 19 78) 



None — on this account t .subjects simply ; 

fail to use disconf irming evidence 



None- 



-the effect is here considered as the 
result of lack of disconf irwing feed- 
back in the subject's environment 



Subjects hypothesize a causal . relationship 

between A arid B. The causal linkage 

A ■ ■ B, has greater evidential intact _ 

than the diagnostic relationship, B 1 A 

(Tversky 6 Kahneman, 1977) 



Information necessary for the construction of 
a causal model , _which enable the intuitive as- 
sessment of uncertainties, must be retrieved 
from- memory. The. attempt to_ create _a causal 
model may restrict the kind of information 
searched 



Availability — salience arid recency of 
events and populations increase th> 
probability of recall but do not increase 
probability of .correct prediction 
(Tversky 6 Kahneman, 1973) 



9e*i entry in (2) (c) , column 3. 
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Table 1 — Continued 



Utility Structure: 

Reported effects in 
intuitive judgments 



Explanation suggested by_ 
authors reporting the effect 



Possible use as a component 
within struc turing heuris tics 



(1) Subjects prefer to 
compare outcomes bh 
individual attributes 
serially rather than 
across attributes 



(2) Subjects tend to 
compare outcomes 
across attributes 
in more complex 
clecislbri problems 



Facilitates use of simpiificat ion tech- 
niques such as canceling out differences 
that are equal or nearly so, and _ reducing 
the number of attributes to be considered 
(Tversky, 1969; Slbvic & Lichtenstein, 
1971) 



Gives some. indication of conditions under 
which attributes are deleted from the 
utility structure 



This comparison .procedure required when 
no common set of attributes between out- 
comes and when data about different out- 
comes not available simultaneously 
(Montgomery & Svensbn, 1976) 



Suggests that to access Information about, 
an outcome on all dimensions simultaneously, 
the decision maker must issue a fairly com- 
plex search instruction 



(3) 



Representation of 
attribute dimensions 
of outcomes as bipolar 
scales (one end of _ the 
scale can be elicited 
by the method of 
triads: from three 
possible outcomes, 
choose word or phrase 
to describe an impor- 
tant respect in which two 
are similar aha the third 
dissimilar) (Kelly, 1955) 



(U 



(2) 



Elicitationof the contrast end of 
bipolar scales by the difference 
method: give a word or phrase to 
describe how the third outcome Is 
dissimilar from the other two 
.{Kelly, 1955; Epting, Suchman, & 
Nickeson, 1971) 



Elicitatibh of the contrast end of 
bipolar scales by the Opposite 
method: give a word or phrase 
which .states the opposite of the 
characteristic given for the like- 
ness end (Kelly, 1955; Epting, 
Suchman, & Nickeson, 1971) 



Gives a procedure for Information search 
for structuring utilities 



Gives a procedure for information search 
for structuring utilities 
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Table 1 — Continued 



Utility Structure (continued) : 

Reported effects in 
intuitive judgments" 



(4) The subject defines a sub- 
set of possible outcomes 
by making- absolute evalu- 
ations bh a single attri- 
bute that refer to a sub- 
jective criterion value 



(5) increasing number of 

outcomes and attributes 
*> df»creh"sihq pro- 
portion of aspects 
searched (Svenson, 1977) 



(6) Differences in weighting 
of dimensions, which _are 
not explicable as differ- 
ences in subjective im- 
portance of attributes 



(7) Subjects elicit possible 
outcomes or relevant at-. ; 
tributes of outcomes by 
imaginative projection 
into possible futures 



Explanation suggested by 
authors reporti ng the effect 



the elimihatioh-by-aspects 3 (Tversky^ 
1972) rule used as a method for engen- 
dering a set of butebmes for which_ es- 
timations of relative worths are then 
made^ and which are subsequently linked, 
in the act-event structure, with specif ic 
immediate acts and uncertain events 



Subjects presumably set criterion levels 
to_restrict incorpbratibn within utility 
structure: to only the most salient or 
relevant outcomes and attributes of 
butebmes 



Attribute dimensions shared By. all. al- 
ternatives weighted more heavily than 
those shared by a subset (Slovic, 1972) 



Scenario generation in utility -Struc- 
turing (O'Connor S Edwards, 1976; . 
Janis S Mann, 1977) 



Possible use as a component 

within structuring heuri stics 

Indicates how subjects access a manageable 
number of butebmes for consideration as 
consequences whose utility structures are 
to be traded off in the decision problem 



No ne —does not help with the que s tion of 
how salient outcomes and attributes 
are accessed 



None — a feature of intuitive assessment 
within utility structure 



Scenario generation may be a procedure hot 
just for e limitation of butebmes but also 
for checking their realism, in the sense that 
ah outcome may be deemed_suf f iciently realis- 
tic to merit consideration if it is .derived 
from a well-defined scenario generation pro- 
cedure {see, e.g., O'Connor S Edwards, 1976) 



*Tver S k v introduces EES ,s a decision rule fpr .hoice of _i [™ ^ToT.l oeen'mitted" ro^ 
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Table 1 — Continued 



Act-Event Structure: 

Reported effects in 
Intuitive judgment 



Explanation suggested by 

authors reporting the effect? 



Possible use as a component 
within structuring heuristics 

None — locates the. effect within the act- 
event structure 



(1) Subjects utilize j>nly 

a subset of information 
available in the environ- 
ment (Svensoh, 1977) 



(1) Subjects are using very simple 
decision rules {Payne, 1976) 

(2) Subjects decrease the number of 
choice alternatives and dimensions 
by the "method of successive 
limited comparisons" (Eihdblom, 
1964) : they consider only those 
alternative? that differ slightly 
from present practices (Cyert & 
March, 196 3) 



A conservative heuristic, severely re- 
stricting information relevant for struc- 
turing decision tree 



(2) Decision __by external 
authority 



Subjects choose between alternatives 
according to cultural or family tradi- 
tion, or by prescription of an expert 
(Hogarth, 19 74) 



-this. sintply_nptes reasons for failure 
to structure uncertainties in viola- 
tion of axiomatic method 



(3) Restructuring decision 
tree _ consequent on a 
reality chock 



Subjects divide attributes of the Out- 
come of a choice alternative into two 
groups, A and B; from levels of A, pre- 
dict_levels_of B; check predicted levels 
against observable levels; if a mismatch, 
delete the choice alternative 
(Humphreys, 19 77) 



This states_a conservative rule specifying 
action to be taken in theevent of a fail- 
ure of a reality check and the conditions 
for applying the rule 
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Table 1 — Continued 



Act-Event Structure (continued) 



Reported effects In 
intuitive judgment 



(4) Because .the subiect sets 
a higher selling price, 
for gamble A than gamble 
B » that the subject 
prefers A to B (Lich ten- 
stein & Slovic, 1971) 



Explanation suggested by 

authors reporting the effect 



Possible use as a component 
within structuring h euristics 



(5) Decision affected by 
h>ivl to justify It to 
othnlfl 



Method of processing information is de- 
pendent _uppn_ the response the subject 

is_ required to make— e.g. , setting a 

selling price. or making a verbal choice. 
"Cbmnierisurabitity between a dimension 
and required response affects importance 
of that information in determining the 
response" (Slovic, 1972) 



None — unless one speculates that response _ 

mode Is a demand characteristic (Orne, 
1962) of the task that determines the 
search ins true t ion the subject uses 
to access information, a search in- 
struction on which only information 
commensurable with the response mode 
Is retrt^ved- 



Justif lability— sub jects take courses 
of action they believe will be readily 
explicable and justifiable to others 
(Slovic, Fischhbff, & LicHtehsteih, 
1976) 



None-- this decision procedure requires 
accessing information from memory 
but gives no indication how this 
access is achieved 
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within repertory grid terminology) into vectors of part-worth ratings on a 
set of attribute dimensions within a preference structure . i5 _ The two prin- 
cipal heuristics discussed by Kelly (1955) for /e limitation of attribute dimen- 
sion .poles are known as the Difference Method (DM) and the Opposite Method (OM) . 
They are reviewed in Bannister and Mair (1968)? Adams-Webber (1970); and . 
Epting, Suchman, and Nickeson (1971). Both these methods are used in MAUD ^ 
an interactive computer program for the structuring, decomposition, and recom- 
position of preferences between multiattributed alternatives (Humphreys & 
wisudha, 1979) . When the decision maker has reached the point in ^i'UCturing 
his. or her decision problem at which at least three alternative terminal events 
are_uhder consideration, and tradeoffs have to be made in determining relevant 
preference between these terminal events, MAUD may be used as an interactive 
aid in developing the preference structure among these alternatives, MAUD 
starts by using the Difference Me thod and a heuristic device to elicit an at- 
tribute dimension. Figure 7 reproduces the relevant portion of a printout 
from a typical MAUD interaction; ^o? 6 ?* 16 ?^*^ comments on the functions of 
the various instructions used in achieving this elicitation. 16 

The material elicited through the use of t±iis heuristic are two words 

(or phrases) that are assumed to define the poles of an attribute dimension 

scaled in terms of a monotonic part-worth preference function, so that .ratings 
of the alternatives under consideration by the decision maker on this dimen- 
sion will index the degree of part-worth 17 of each alternative in terms of 
the degree to which they possess the relevant attribute . 

Since the processes involved in the decision maker's semantic memory in 
forming the output shown in Figure 7 are not explicitly modeled, we cannot be • 
sure that the elicited words have the required characteristics, as just out- 
lined. However, we can perform a number of checks to test whether tteneces- - 
sary assumptions are met by the elicited words . These have been reviewed by 
Humphreys (1978a) as range of convenience Ufter Kelly, 1955) -, which estab- 
lishes the possibility of actually making tradeoffs involving each and every 
alternative's rating on the attribute dimension; bipolarity, which requires 
that the poles be mutually exclusive and cumulatively exhaustive to insure an. 
unambiguous uni dimensional scale between the poles; and raonotonicity, which 
insures that increasing numerical scale values index increasing preference. 



15 These dimensions are called constructs within repertory grid terminology. 
However, the repertory grid decompositio. joes not represent a^pref erence 
structure , because the ratings on constructs are J-scaled (linear between 

poles as defined, with no consideration of the position ideal point or the 

dimension) rather than I-scaled (part-worth,, preference ratings). Coombs (1964) , 
Humphreys (1977, section 4), and Humphreys and Wisudha (1979, section 3-5.1) 
discuss in detail the folding relationship between J-scaled and I-scaled rat- 
ings on an attribute dimension-' 

16 MAUD usos the Opposite _Me thod in preference to the Difference Method when 
more than two attribute dimensions are already present in the preference 
structure . However, should the Opposite Method fail to elicit appropriate 
poles, MAUD will then (temporarily) revert to use of the Difference Method. 

17 For a discussion of part-worth, see Kneppreth et al. (1974). 
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Interaction (user's responses are underlined) 



Comment 



Can you specify a way in which one of the following: 



{1} LECTURER AT POLY 

{ 5 J RESEARCH AT UNIVERSITY 

I3> MARKET RESEARCH 



differs from the other two (for your present" purposes)? YES 



What is the number beside the 
that differs? 1 



dOB 



Elicitation instruction -designed to 
activate relevant portion of user's 
semantic memory five jobs were'^cur- 
rently under consideration; MAUD 
chose three of them at random for use 
in this application of the Difference 
Method, 



Activation is successful. 



You hnve. said that MARKET RESEARCH ,, J" 

is U i f f ererit f rom: 

LECTURER AT POLY and RESEARCH AT UNIVERSITY 

Please type one or more words on the sane tine describing 
a way in which MARKET RESEARCH differs: 



MARKET RESEARCH 
NONACADEMIC 



i s : 



On the other hand, 
LECTURER AT POLY and 
ACADEMIC 



RESEARCH AT UNIVERSITY are: 



Are you reasonably happy with this description? YES 



Confirmation of output from user 1 s 
semantic memory by MAUD. 



Elicitation instruction requesting 
user's specification of P^les of 
attribute dimension resulting from 
above activation of semantic memory 
(together with user's output) . 



confirmation check 



Figure 7. Interaction between decision maker and MAUD using 

the Difference Method to elicit poles of an attribute 
dimension. 
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If any of the checks of these assumptions fails, then the numbers assigned 
to alternatives on the offending attribute dimension will of necessity be inco- 
herent Within the utility buffer system shown in figure 3 (and within any of 
the other decision-theoretic subsystems with which it is interfaced) - To re- 
store coherence, restructuring activity is required: Humphreys (1979) describes 
techniques designed to accomplish this as reordering techniques, as distinct 
from ordering techniques used to elicit initial (unchecked) components of the 
structure, similar to the Difference Method and Opposite Method outlined earlier 

Reordering. techniques, like ordering techniques, involve crossing the 
interface with semantic memory and therefore involve heuristic devices. How- 
ever, the various heuristics employed do not stand in isolation or in competi- 
tion with one another; they can be conceived as integral parts of an ordering 
and reordering system that invokes heuristics as appropriate and checks the re- 
sults, passing the results across the interface to the decision-theoretic sub- 
system if the checks are passed. If, on the other hand, one or more checks 
rail, other heuristics are invoked and a further set of checks made, with the 
. system remaining active until a set of checks is passed in tbtb. 

This type of system can be modeled as a production system. In the preced- 
ing section, we outlined a production system representation for heuristics in- 
volved in structuring Operations. The next section shows how an embryonic 
form of such a system is currently employed in MAUD. 18 MAUD's production sys- 
tem is probably the most advanced available in any current computer-based 
general purpose decision-aiding device, but it is still extremely limited. 
Before we can go further in building and testing production systems to handle 
structure ordering and reordering activities in decision aids involving trans- 
actions across the interface with semantic memory, we need a better understand- 
ing and specification of those heuristics that might be useful candidates for 
inclusion in such a system. Section 4 is concerned with the identification 
and classification of such heuristics-. 

5.2 Production-S ystem Con trol of Structure Ordering 
and Reordering Activities 

This section outlines the way in which MAUD (Humphreys & Wisudha, 1979) 
uses a production system to control the structure ordering and reordering 
heuristics it employs in forming a preference structure described in terms of 
fully decomposed assessments of part-worths of a set of terminal events (out- . 
comes) on utility- independent attribute dimensions. This system is, as yet, 
in its early infancy and has limited capability within a circumscribed area 
of the province of decision theory. However, it has proved very successful 



18 See also Humphreys and Wisudha (1979, sections 2 and 3) . 

19 Other systems, such as OPINT (Selvidge, 1976; Allen et al., 1976) have com- 
prehensive structure-reordering devices that operate within a decision-theo- 
retic subsystem (the event buffer system. in Figure 1 in the case of OPINT) . 
Such systems operate according to normative specifications. White they are 
sometimes organized according to a production system, they are not considerea 
here because they do not necessarily involve the invocation of heuristic 
devices. - • 
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In practiced arl d this success has led us to propose Sat much more flexible, 
comprehensive systems be developed as soon aswe have a better command of_the 
building blocks for such systems: structuring heuristics of the type outlined 
in section 4. 



Sere we shall be concerned only with the control of the section of MAUD 
that deals with ordering and reordering the decomposed preference _ structure . 
It is interfaced with other sections of "MAUD* which handle operations such as 
specification and revision of the set of terminal events among which prefer- 
ences, are to be traded off within the structure, felicitation, and revision of 
the relative value-wise importances of the attribute dimensions comprising the 
current preference structure and so on. 

Control is passed to this section of MAUD whenever a decision maker wishes 
to order (expand) or reorder (revise) the preference structure currently under 
consideration. (Even if this involves interrupting another task.within the 
decision analysis, the ramifications of the interruption is handled at a higher 
level of control within MAUD.) Control within the section resides in an 
APPLYLIST 22 of 15 productions. Each production (p) is of the form: 

P : {C H> A} * 

where C is a vector of one or more conditions that must all obtain at the 
moment the APPLYLIST is scanned for that production to be implemented. A. 
is a vector of one or more actions (procedures) that will be carried out by 
MAUD upon implementation of the production. Some, but not all, of these pro- 
ductions will involve interaction with the. user. The actions transform the 
preference structure, and they also set; appropriate condition flags during 
their execution. Certain condition flags may also be set at any time by the 
user overriding a request for particular input by MAUD with an interruption,^ 

These productions, and their order of priority in the APPLYLIST, are 
shown in Figure 8. The conditions sensed and actions taken are defined as 
follows: 24 



?° Se e Humphreys (19 78b) fcr a report of the use of this system with a wide 
range of decision makers and ah analysis of gains made through its use. 

21 See Humphreys and Wisudha (1979) for details of these operations. 

22 APPLYEIST and otter technical terms used in this section are defined in 
Appendix A. % 

23 For instance, MAUD may request ratings of terminal events on an attribute 
dimension, but the user may reply that he or she is unhappy with the current 
definition of the dimension. The production system is designed to handle such 
interruptions in whatever way is most appropriate. 

24 The number in parentheses after each. condition and action refers to the ^ 
section in Humphreys and Wisudha (1979) in which these conditions and actions 
are described in detail. 
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ENTRY 



I 

PI 
P2 
P3 



P6 
P7 
P8 

P9 
P10 

pii 

pi2 
pi 3 

P14 
P15 



EXIT 



{C6 A7> 
{C5 ■+ A5> 
{C3 ■* A7, A3> 



user-initiated deletion to 
part of preference structure 



P4 : {C8 A13, A9 , A10> 
. P5 : lCA + A9 , AlO } 



user-initiated change of content 
within preference structure 



lC15 + A16} 
{C14 + A15} 
{C13 A9, Alb} : 

{C12 + A8, All} 

{Cll + *12, A18, A14} 

{CIO A5, A6, A17} 



consequences of failure of MAUD- 
initiated check of adequacy of 
decision-theoretic model 

MAUD-initxated gathering of 
content within preference structure 



{C2 + A4 f A19} 

{C7 A4, A19} 

tbi & C2 & C16 ■+ A2, A3} 

{CI + Al f t A3} 



user-initiated extension of 
preference structure 



Note. Productions are numbere 
APPLYLIST. 



no further ordering- reordering 
operation required: task accomplished 

d in order of priority of execution within the 



Figure 8. Productions used to control preference structure 
ordering and reordering activities within MAUD. 
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Cl = The decision maker using MAUD (the user) wishes to have his or 

her semantic memory prodded to aid the eiicitatibri_bf the prefer- 
ence structure relevant to the decision problem under considera- 
tion (i.e*i tradeoffs .between a set of terminal _ events; or out- 
comes leading to the formation of holistic preference values for 
those outcomes) . (2) 

- _ ■ C) 

C2 = User is willing to define poles of an attribute dimension on the 

basis of the current (MAUD- gene rated) felicitation instruction. (2) ' 

C3 = User is not happy with current definition of poles of ah attribute 
dimension. (2) 

C4 = User is hot happy with current ratings on an attribute 
dimension, (2) 

C5 '= User wishes to change current ratings on an attribute 
dimension. (2) 

C6 = User wishes to cancel/delete an attribute dimension from the 
current preference structure. (2) 

C7 = User wishes to add an attribute dimension. to the current 
preference structure. (2) 

C8 = User is not happy with the current position of an ideal point 
on an attribute dimension. (3.5.1) 

C9 - More than two attributes are in current preference structure. 

CIO = Poles of an attribute dimension are defined, but ratings of 

terminal events (outcomes) on the scale spanning the poles are 
incomplete or absent. (3.2) 

Cll = J-scaled (raw) ratings of terminal events on a dimension exist 
but^are not folded about the current ideal point on that dimen- 
sion to give I-scaled (preference) ratings. (3.5.1) .> 

C12 = Ideal point is not currently set on an attribute dimension. 

C13 = Inadequate variance exists in I-scaled ratings on : an attribute 
dimension. (3,5.2) 

: C14 = Statistical independence check fails between I-scaled ratings 
on a pair of attribute dimensions. (3.3.2) 

CIS = Utility independence check fails in thought experiment conducted 
by MAUD in interaction with user. (3.3.2) 

Cli = Opposite .Method heuristic for activating semantic memory 
failure flag hot set. 
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(2) Rctions (procedures executed by MAUD) 

Al = Use Difference Method (DM) heuristic to activate semantic memory 
concerning attributes to be 1 added to the current preference . 
structure. (2) 

A2 = Use Opposite Method (OM) heuristic to activate semantic memory 
concerning attributes to be added to the current preference 
structure. £25 

A3 = investigate whether user wants to define poles of a new attribute 
dimension. (2) 

A4 = Elicit poles of new attribute dimension from user. (2) 

A5 = Elicit rating of terminal events (outcomes) currently under 
consideration as a J-scale spanning the poles of the current 
attribute dimension. (3.2) ; 

A6 = Investigate adequacy Of J-scaled ratings on current attribute 
dimension. (3.2) 



A7 = Cancel/delete current attribute dimension. (2) 

A8 = Elicit ideal point on current attribute dimension. (3.5.1) 

A9 = 



A10 



All 



: Give user the option of canceling current attribute dimension. 
(2) 

= Give user the option of changing his or her J-scaled ratings on 
current attribute dimension. (2) 

= Check whether user is happy with the current position of his or 
her ideal point on a specified attribute dimension. 

Al2 = Fold J-scaled ratings about the ideal point on an attribute 
dimension to form I-scaled ratings. (3.5.1) 

Al3 = cancel ideal point on specified attribute dimension. 

Al 4 = Check I-scaled ratings on current attribute dimension ^statis- 
tical independence with I-scaled ratings on _ all other attribute 
dimensions active within current preference structure . (3.3.1) 

AlS = Conduct thought experiment with user to determine whether 
specified pair of attribute dimensions exhibit utility 
independence. (3.3.1) ■ 

_ neiete specified (utility noninrtependent) pair of attribute 
" dSnsions from current preference structures; 

pair of poles (defining new dimension within current preference 

structure). (3.3.1) 
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= Cancel Opposite Method heuristic failure flag. 

» Check for adequate variance in I-scaied ratings on attribute 
dimensions. (3.3.2) 

A19 = Check whether user is happy with the definition of poles of 
current attribute dimension. (2) 

- in operating the production system-, the productions on APPLYLIST shown 
in Figure 8 are scanned in order of priority, always, starting from the head of 
list. As soon, as a condition specified in a production is matched to 5 condi- 
tion currently obtaining, ; the action i iropiied by that production is implemented 
in the sequence shown. On completion or interruption of the specified actions 
(either by MAUD or the user) , control is immediately passed to the search of 
the APPLYLIST, which is scanned again. This cyclical procedure continues until 
the APPLYLIST is scanned completely with no production being activated. At 
this point, the structure ordering or reordering task is complete, and control 
is passed back to a higher level within MAUD. 

This system has the great advantages of being flexible and capable of 
rapid expansion in future developments of MAUD^ without running the risk of 
the control system getting out of hand or becoming indeterminate under partic- 
ular conditions. It also gives us the ability to use and check heuristic pro- 
cedures in an efficient way, let MAUD and the user share the direction of con- 
trol, and still perform efficient housekeeping activities designed to minimize 
the extent of incoherence in the preference structure under development^ More- 
over, exit is not possible from the production system until the reordered pref- 
erence structure is coherent; so the whole system can serve safely as a module 
for incorporation in a larger system, because it has only a single entry and 
exit and requires no external control . 

The system is, of course-, still limited, but our .experience to date . 
indicates that it will serve as a satisfactory basis for the development gf 
much more comprehensive systems in the future^ involving many more heuristic 
devices than those incorporated in 'the current version of MAUD. 



6. STRUCTURING UNCERTAINTY 

In section 3.1 we discussed two systems that can help the assessor deter- 
mine a probability distribution for some target event — PIP systems and influ- 
ence diagrams . Both systems were shown to act as buffers between the assessor's 
semantic memory ahd_ the core act-event subsystem. The systems facilitate prob- 
ability assessment by providing structure, usually "in disaggregated form, to 
uncertainty about the target event. 

These are not ,the only two systems that can perform this function. As 
we reviewed systems for struc turing uncertainty^ it became clear- that four 
fundamental strategies cover all the structuring systems currently in use , 
as well as those -we could imagine might be helpful. We discuss these strategies 
in the next section-,- and then in section 6.2 we outline a new buffering 
subsystem. 



A17 
A18 
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6.1 Current Systems 

An individual who must assess uncertainty about some target event can 
approach the problem in one of four ways, as shown m Figure 9. 

1 



Use holistic 
judgment » 




_/ TARGET EVENT \ 




Extend the 
conversation 





1 
1 




t 




Sr i 
\ 1 





\ 

1 



Use Bayes' 
theorem 



Determine, 
functional 
relationships 



Figure 9. Ways of assessing uncertainty 
about some target event. 



44 

54 



Holistic judgment includes not only carefully considered judgment. about 
the target event itself, but also judgment based. on relevant historical data; 
Ftir example, uncertainty .about projected sales might be based on the past 12 
months 1 sales figures, adjusted to take account of special conditions like 
inflation or hew sales taxes that might prevail for the next 1? months. 
Strictly speaking, holistic judgments are not buffered; semantic memory is 
linked directly to .the core act-event subsystem. However, holistic judgments 
are made frequently in most decision analysis, so this strategy for assessing 
uncertainty is included here for completeness. 

When an assessor finds that uncertainty about the target event is diffi- 
cult to assess because probabilities depend on other events, it may be useful 
to extend the conversation to include these other events. For example, if the 
probability assigned to event ^ E is thought to be different if event F occurs 
than if it does not occur, then the assessor could be asked to assess the con- 
ditional probabilities p(e|f) and p(e|f) , along with the unconditional proba- 
bilities p(F) and p(F) . The probability associated with event E can then be 
calculated: 

p(E) = p(e|f) P (F) + p(E|7)p(F) 



If assessments of -the probabilities associated with the occurrence and nonoc- 
currence of F prove difficult without considering event G, then a further ex- 
tension of the conversation can be made to include event G. In this way, any 
number of related events can be considered. Technologies, or buffering sub- 
systems, that are based on extending the conversation, include influence dia- 
grams , event trees, and fault trees. At a theoretical level, there is no 
difference between these three technologies. 

Two situations may lead the assessor to use Bayes' theorem. In extend- 
ing the conversation, the assessor may be required to assess p (F |g) but may 
find it easier to think about and assess the inverse probability p(g|f) . 
The earlier probability can be turned into the required probability by using 
Bayes 1 theorem, sometimes called the theorem of inverse probability: 

pfF|G) , zmmki 

This type of structure is often referred to as "flipping the decision tree." 
The other situation in which Bayes' theorem is useful occurs when data are 
available that affect one's uncertainty about the target variable. The PIP 
system discussed in section 3.1 is an example; we might call this buffering 
subsystem a simple inference' structure . Cascaded inference structures are also 
in use. Observable data reduce uncertainty about some unobservable_ indicator 
or factor, which in turn reduces uncertainty about the target variable. An 
example can be seen in insurance underwriting. A factory's trash disposal 
facilities can be directly observed. These, along with other data, give a 
fallible indication of the state of housekeeping, which is one of several 
factors that bear on the degree of fire risk posed by the factory. Another 
example is that of sensor uncertainty. A solid sonar return is a fallible in- 
dication of the presence of an enemy submarine, whichin tarn has some bearing 
on the extent of future hostilities between two adversaries. 
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Another way to disaggregate the target event i, to deiermi g ^ ^ c ^f 
relationships the target event may have with other ^f^-Jl^Till salt 
is ah uncertain quantity, then it may be a function of other quantities, some 
of which are aisb uncertain, if the functional relationship between the target 
variable and these other variables can be determined, then assessments carvbe 
made of the uncertainty associated with the other variables and the probability 
diitribuSon over the target variable calculated or determined by Monte Carlo 
simulation. 



All of the uncertainty structuring systems we Have encountered use one 
or more of these four strategies. 25 

6.2 Buffering for Functional Relationships 



When it is difficult to assess uncertainty about some target eye, . because 
the event is complex, it may be possible to determine the functional relation 
ship of the event to other, simpler events. Then uncertainty can more confi- 
dently be assessed for the simpler events. A probability distribution^ over 
the target event can be calculated if the functional relationships are simple 
Sough lor this procedure to be mathematically tractable or determined by 
Monte Carlo simulation. 

What are the structural elements that could be used in this type of dis- 
Tvoicallv they are the same as those used in extending the con- 
vlrsaSn event (ana' tSlr outcomes) , uncertain quantities and P-babilities 
associated with the events, or uncertain quantities, mis zn tZTr- 

tary level of disaggregation familiar to decision analysis. However an alter 
native level of disaggregation may often be more useful, especially when an 
interactive computer system is being used. 

The approach can be illustrated with an example. One Of the authors was 
asked to help S marine claims section of a large insurance company to improve 
Its estimate! of the eventual size cf a settlement i« «" s °< J° ^ 

hull of a ship. Soon after an incident occurs, the- claims department is 
notified of the accident. They are given only a brief description but the. 
information provides a rough basis for judging the eventual size of J* e J^ tle 
menfof the claim. There is often considerable Certainty associated^ 
this estimate. (The estimate is required for a variety of reasons; an example 
is ttiat reserves must be set aside in a fund out of which claims are paid.) 

After many hours of discussion with the head o| the sect ion and Rowing 
many revisionsand alterations, the model shown in Figure 10 evolve^ The 
eventual size of the settlement can be expressed as the P"^ u " ^a 
titles- the net size of the claim, an image factor, a relationship, factor, 

that includes a simple pre structured tree with a -Retarget even 
certainty can be modeled with an influence diagram, supplemented (optionally) 
by a simple inference structure. 
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surrounding the claim may be adverse, which could lead the insurance company 
to pay but extra sums to preserve its ; image ; Even if the circumstances are 
hot adverse, the multiplier might be greater than one,, though hot so much as 
if the circumstances are adverse. Thus, uncertainty about the size of the 
factor is modeled in two stages: first, probabilities are i assigned to the 
circumstances being adverse or hot adverse; and second, two probability dis- 
tributions over the factor are assessed, one conditional on the circumstances 
being adverse, the other on their not being adverse. Similar structures hold 
for the relationships and handling factors. 

The net size of a claim is disaggregated into two quantities,, the total 
cost les£ the net costs recoverable from a third party (if applicable) - Total 
cost is further disaggregated into the size of the loss less a reduction for 
negligence plus the size of additional payments. Uncertainty about the size 
of the loss is expressed as a probability distribution over that quantity,, 
which is bounded by the deductible at the lower end and by the amount of the 
indemnity at the upper end. A reduction for negligence may not apply; if it 
does, and this is assigned a probability, then the policy specifies that the 
size will be 10 percent of the size of the loss.- Additional payments may not 
be necessary; if they are , for which another probability is assigned, then a 
probability distribution is assessed over the size of these payments. 

Net coses recoverable from a third party are calculated by multiplying 
the total cost by a proportion of the total cost that is recoverable from a 
third party. Of course , costs may not be recoverable , but if they are (with 
some probability, which must be assessed) , then a probability distribution 
over the proportion must be assessed. 



In the figure, the shaded boxes identify the events and uncertain quan- 
tities for which probabilities must be assessed. Depending on the structure, 
assessments may be associated with discrete events, uncertain quantities, or 
uncertain quantities conditional on event outcomes. 



Once the required assessments are made, a probability distribution over 
the eventual size of a settlement can be obtained by Monte Carlo simulation. 

Note that each shaded box represents a structure based on the simple .__ 
ingredients mentioned above : events and their outcomes, uncertain quantities, 
and probability distributions. However, some of the boxes are identical in 
structure: all the factor boxes are the same ; the two bottom right boxes are 
also the same- Is it possible that, at this level of structuring, only a few 
structures are needed to represent most disaggregated target events? If so, 
then these few structures could be preprogrammed in a computer to serve as 
generic building blocks that would enable a user to model uncertainty about 
almost any target event. 



6.3 Modular Uncertainty Structure 

we believe that there are only a few basic structures; we call them 
modular uncertainty structures (MUSs) . Although many more structures are, of 
course, possible, we think that those listed in Table 2 should be sufficient 
for most problems . 
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Table 2 

Modular Uncertainty Structure 



Inputs 



Structure 



Name 



E ' E ' C E ,c i' p 
either U and U- 

E I! 

or C f C- and f 
E E 




binomial 
distribution 



n r ^9 r • • • f ^j^ 

P 1' P 2' fP n f 
either U 1 ;ti 2 ; ; . . ,U n , 



or7 C r C 2 , 



,C ari d f. 
n 




u 1 =f(c 1 ) 



n_ t^=f(C-3 
n n 



multinomial 
distribution 



selected fractiles , f,g 

(optimal: max,miji, 

truncation) 




where C x =f(x) 



U =g(C ) 
x x 



continuous 
distribution 



1 



selected fractiles, f,g, 
X,p. (optional as in 3) 




where C =f(x) 
x 



U-=f (C-0 
x x 



mixed 

distribution 



E,E,Cg,p, 
fractiles, f,g 




G-=g(cJ 

X x 



where C x =f(x) 



one 

conditional 
distribution 
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Inputs 



Structure 



Name 



6 ) e;E;p 

fractiles for x,f,g 
fractiles for y,h,i 




U--*g<C-) 
x x 



where C=f(x) 
x 



U ~i(C ) 

y y 



where C^=h (yj 



two 

conditional 
distributions 



n ,E^ /E^ / • • • 9 

fractiles for x,f ,g 
fractiles for y,h,i 



fractiles for z,j,k 




conditional 
distributions 



where C„=f <x) , cy=h(y) , C-=j(z) 



X (rate parameter) 
e and f 




U^f(O) 



U 2 = f (2C) 



U-=f (riC) 
n 



poisson 
distribution 
with known 
consequencer 
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Inputs 



Structure 



Name 



[ 9 ) X (rate parameter) , 

fractiles for C and f 




U =f (nC) 
n 



poisson 
distribution 
with un- 
certain 
consequences 



IGj E f E f F f F 

p(E) ,p(F|E) ,p(F|E) 




single 
influence , 
binary 
events 



Names of events and 
their partitions , 
conditional probabilities 
for all linkages, uncon- 
ditional probabilities 
for lowest events. 




multiple 
influence 
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Inputs 



Structure 



Name 



Hypotheses, H; Data, D 
Prior probabilities, p{H) > 
likelihoods, p(d|h) 




simple 
inference 



Hypotheses ^ H; 
Indicators, I; Data, 
prior probabilities, 
p(H) ; p(I H) ; p(D I) 
(More precise speci- 
fication given in 
Kelly & Barclay, 
1973) 




hierarchical 
or cascaded 
inference 



Note. 



For cases 3-9, utilities may be expressed directly rather than as 
functions over consequences. 



*List of structural' elements: E : event; p:. probability; U: 
C: consequence; f ,g,h,i , j ,k: . functions. - 



utility; 



We can envisage a computer program, that . includes these 13 MUSs as the 
building blocks, in _a .generic structure-building program _^y__specific model 
could be built by defining disaggregated variables and their relationships r 
and then by assigning the appropriate MUS to each disaggregated variable. 
Each MUS used would then request the appropriate inputs . from _ the user. Rou- 
tines for assessing probability distributions could be included in the program 
to help the user generate coherent assessments. 

It is possible that this program could be used by people who have some 
technical training but are not experts in decision, analysis . By raising the 
structural level to the. MUS from the rather molecular level used by decision 
analysts, buffering with semantic memory systems may be facilitated. The MUS 
structure may more closely represent internal structures built vp by the ex- 
pert in dealing with a particular class, of problems over many years. 



CONCLUSION 

The reconceptualization of decision theory, presented in section .3 of this 
report, enabled us to outline the current limits of formal decision theory, 
and to go on in sections 3, 5, arid 6 to explore beyond these limits, with a 
view to extending decision-theoretic methodology into the fxeld of structuring 
decision problems. In section 4, we argued the case for the development of 
heuristic aids to structuring and suggested programmatic guidelines for this 
development; section 5 described the preliminary implementation of some such 
aiding devices within the structuring capab±i±ty_of MftUD. Section 6 pointed 
out a direction for further work in aiding the structuring of uncertainties by 
the use of modular uncertainty structures. The implications of the work de- 
scribed and the recommendations for future work are stated explicitly within 
each section. 

What remains to be done is to contextualize these research efforts within 
an overview of the procedures involved in the process of decision structuring . 
We suggest such an overview next, decomposing the structuring process into -± 
series of operations and suggesting yhere within this. series the candidate 
structuring heuristics isolated in Table 1 of this report may be usefully 
employed . * N 

Our review of the currently available work on structuring heuristics, 
summarized in Table 1, has led us to identify the following heurists as -worthy 
of further investigation as candidates for inclusion within structuring systems, 

• Representativeness: a search instruction for making_ judgments about 
a present case by reference to a class encoded iri memory. 

• Causal schemata: ft model of the world accessed from memory for 
judgment-making about present cases. 

• Availability as a memory search instruction. 

• Inter- and intra-attribute comparison and assessment of attributes 
of consequences . 
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• Search procedure determined by representation of attributes of conse- 
quences as bipolar scaies. 

• Elimination-by-aspects used as a procedure for reducing sets of options 
to be assessed. 

• Systematic scenario generation: a strategy for eliciting realistic 
consequences of actions. 



. Conservative Heuristic for deleting actions from option set by compar- 
ing observed and predicted levels of attributes (Sheppard's investment 
manager's heuristic). 

• A strategy, dictating that only those alternatives approximating to 
present practice are included in the option set. 

However, the specification of some candidates for inclusion within a deci- 
sion-structuring system is merely One step toward the construction of such 
Systems. What is needed in addition is a specification of a struct «™B«g£ 
tem architecture into which each of these candidates may be fitted to aid the 
structuring of decision problems. In Figure 11 we present in general form a 
proposed architecture for such systems. 

The roles of both the environment (represented as block 1 of Figure 11) 
and the constantly changing content of the decision jnaker • s. semant ic me 
(represented as block 2 of the figure) are explained in section 4 and in Appen 
dix I The right-hand column of blocks in Figure 11, presenting fairly gross 
descriptions of structuring operations necessary for providing the required 
inputs to a decision-theoretic evaluation model, concerns as here- 

If th- decision maker has recognized that a decision problem exists, 
we hypothesize that an interactive procedure, incorporating the operations de- 
scribed in blocks 3 to 8 in Figure 11 will provide inputs crossing the inter- 
nee with the decision-theoretic system; adequate for assessment of a decision- 
theoretic model of the problem. Thus, the operation described in block 5 
provides the option set to be evaluated within the decision-theoretic core 
svstem (see Figure 3 . Block 6 structures those uncertainties arising 
wilhih Si decision problem necessary for numerical assessment ^thin the 
decision-theoretic probability buffer system. Block 8 provides information 
concerning the criteria for evaluating consequences of actions necessary for 
the functioning of the decision-theoretic utility buffer system. 

Blocks 3, 4, and 7, while not directly responsible for output into the 
decision-theoretic system, constitute the means whereby the decision maker 
constructs an Internal representation of the problem requisite for the pro 
auction or such output. The decision maker's destruction of « 
of his or her initial state (at block 3) is a necessary condition for the 
categorization of the decision problem at block 4, and it is by means of this 
categorization26 that possible action plans for solving the problem are con- 
structed at block 5. The" decision maker's understanding of his goal, con 
structed at block 3, not only conditions the action plans, constructed at . 



26 See von Winterfeldt, 1980. 




1. The environment: 
exogenous and in- 
direct determina- 
tion of decision 
structure . 



2. Decision maker's 
semantic memory ac-_ 

tivated: endogenous 

and direct determina- 
tion of decision 
structure . 



< 



A 



J. 



(Deactivation °^ 
semantic memory) 



.<• 



(new activation of 
semantic memory) k£ 
i 



A 



(new activation of 
semantic memory) 



v - - - 



( new _ activation of 
semantic memory) 



A 



: x/ 



_< 



(new activation Of 
semantic memory) 



input . 

checking operations resulting 
in restructuring if checks 
fail (checks such as coherence, 
realism,- and completeness) . 



3: Represent initial 
state and goal: 



A 



4. Categorize the prbblem-- 
relate problem to appropriate 
Problem _ class by judgments 
of similarity. 



5 A Construct action plans 
(choice .alternatives) by 
creating links between ini- 
tial state and goal (if.", 
close similarity at 4, then 
action plan retrieved rather 
than constructed) . 



A 



6. Specify relevant uncer- 
tainties by consulting see* 
narios of future, viz., ex- 
ploring paths created in 5 
above . • 



7. Specify possible conse- 
quences of action plans by 
consulting scenarios of. 
future . 



8. Construct criteria for 
e Y§iuation of consequences. 
These criteriathen used to 
assess degree to which the 
various consequences lead 
to achievement of goal. 



A 



J 



Inputsto decision- 
theoretic system 



Figure 11. Diagram of basic operations required for creating a decision 
structure adequate for evaluation by the decision-theoretic 
; system. 
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block 5, but also determines the criteria used. for evaluation Of the conse- 
quences of actions at block 8 in conjunction with the descriptions of conse- 
quences of actions at block 7. 

If this constitutes a viable general description of a structuring system 
architecture, how might the candidate heuristics referred to above be employed 
within tt? Each of blocks 3 to 8 in Figure 11 represents the^site of operation 
of one or more of the candidate heuristics > as summarized in Table 3. • 

Rather than stating all of our reasons for assigning each heuristic to 
each structuring site in Table 3, we will .concentrate on one : e ^^.~^^ f 
representativeness. Rep- ^sentativeness may be a. useful heuristic in circum- 
stances in which it is appropriate to attempt to throw light on the present 
problem by reference to a class encoded in memory It can thus ; be useful in 
categorizing a decision problem, represented as block 4 in Figure 11. However, 
In reinterpreting Tversky and Kahneman's research in representativeness in ^ sec- 
tion VT. we have identified a further site of structuring operations at which 
representativeness may prove to be of help-namely in structuring the decision 
problem in such a way that uncertain events are assigned to classes, the sub- 
sequent numerical assessment of probability ^ the event bein^determined^by 
the degree of fit between class and number. Thus it appears that represents 
tiveness also has a role in determining the output from block 6 of Figure 11. 

These heuristics are in no way exhaustive of those we may need to con- 
sider in developing decision-structuring, systems, and we consider that the 
best way to proceed is to start with systems of limited scope and expand the 
scope in interaction with decision makers facing a variety of dec i s ion- s true 
turina problems . There is also a pressing need for a delineation of those 
struc?uSng activities that could profitably be incorporated within a computer- 
based decision aid, and those that_wouid reside fetter -thin^the head of a 
° priqion analyst It is our contention that aiding techniques that require 
knowledge of the world (or a simulation of the current contents of the decision 
Ser's 9 semant?c memory) should not be automated because any device J^P^f 
wtuld have also to be programmed with an enormous data base that would have 
to be constantly updated in the light of new information from every conceivable 
source Tne nuLn P brain is likely to remain the best information processing 
and storage system of this type, at least within the forseeable ruture. 

We consider that such decision structuring systems should be controled 
through a production system organization of the type now in use (in embryonic 
form) in MAUD and outlined in section 5. 
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Table 3 

Sites of Operations of Structuring Heuristics 



Site of structuring operations 



Suggested heuristics operating at site 



Represent initial state 
and goal 
(block 3) 

Categorize the problem 
(block 4) 



Construct action plans 
(block 5) 



Specify relevant uncertainties 
(block 6) 



Specify consequences of 
alternative actions 
(block 7) 



Construct criteria for 
evaluation of consequences 
(block 8) 



J Causal schemata 
availability 



Representativeness 
Causal schemata 
Availability , 

Elimination-by-aspects 
Sheppard's investment manager's 

heuristic 
Access choice options approximating 

to present practice 
Availability 

Representativeness 

Causal schemata 

Systematic scenario generation 

Availability 



Inter- and in t r a - a t tr ib ute ' i hformatio n 
search 

Systematic scenario generation 
Availability 



Search procedure determined by 
representation of criteria as 
bipolar scales 
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APPENDIX A 
PRODUCTION SYSTEMS AND SEMANTIC MEMORY 



The production system (PS) provides a convenient tool for representation 
of methods, almost irrespective of how the researcher is disposed to analyze. 
Sem iichever answers are favored to all the technical questions concerning 
the representation of knowledge, a specific PS system architecture can ho - 
signed for their specification. Whether a theory requires, for example, serial 
(NewenTsimon, 1972). or parallel (Anderson, 1976) implementing of processes, 
or a mixture of the two (Newell, 1973); whether its short-term memory data 
base is last-in first-out or first-In first-out; or whether an n-slot model of 
short-term memory (Newell, 1973) is used, or it is modeled as an_|Ct xjjpK tx- 
tion of an associative network in long-term memory (Anderson, 1976), the PS 
representation provides a precise and convenient modeling tool. 

All the contents of any structured data base, of which that conventionally 
called long-term memory by experimental psychologists is of principal interest 
in personalist decision analysis, may ^represented as^ procedural 
(knowing how) as in the Newell (1973) model. Thus Newell takes long-term 
memory to consist entirely of an ordered set of productions eg., 
our knowledge of procedures and our declarative knowledge of facts abou. the 
worlfmay be separately represented. Anderson's (19 76) model, which he calls 
ACT is of this type. In ACT, declarative knowledge is represented as a 
prepositional ne^otk encoded in semantic memory, while goal-seeking -thods 
procedures are specified as production systems The ^^^^^976 
is composed of complex configurations of nodes and links. Anderson (1976, 
p: 147) describes these as follows: - 

The nodes in the network such as ACT are intended to represent "ideas" 

The links represent access relationships or associations. That 
is! 'the links represent which ideas can lead to (elicit) each other. 

Factual knowledge is represented as a set of propositions encoded 
the structure of each proposition being encoded as a set of nodes and relations 
miT) between nodes. Syntactic principles are invoked as a check upon the 
validity of propositions. 1 

Heuristics, specified as production systems , operate on this prepositional 
network which constitutes the structured data ^.JZ~!^J^J£**£ 
. 0 ^ production systems are invoked both to periorm judgmental tasks Itne 
output from S system) and to encode new propositions into the semantic memory 
nPtwork Th"structure and con ten c of the network both determine which pro- 
ductions can be invoked and provide the data structure that motivates the n,- 
pSe^ation of particular productions, in the manner outlined in Figure A-l . 
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Figure A-l. Steps in the operation of a production system processing inputs 

and outputs across interface between semantic memory and a 

decision-theoretic system. (The interfacing is shown in Figure 3.) 

Productions are implemented as a result of a match between the conditions 
of productions and the contents of active memory. The matching check is per- 
formed on a subset of the total repertoire of productions available to the sub- 
ject This subset is composed of those productions that are potentially appro- 
priate to the task environment and is labeled the APPLYLIST. An initial check 
of active memory is required to draw up the APPLYLIST. Hence, access to the 
prepositional network- is required at_twb separate stages of . production imple- 
mentation: in drawing up an APPLYLIST of potentially appropriate productions, 
and in the selection from the APPLYLIST of those productions - to< be implemented. 
However, access is restricted solely to that portion of the subject's memory 
that is currently active. 

Any artificial model that purports to nave psychological significance 
must restrict memory access so that all encoded elements are not accessible 
at any one moment in time. Newell (1973) achieves this by restricting the 
data structures that form the bases for the implementation of productions- to 
a short-term memory. Anderson's (1976) model, on the other hand, is such 
that, while the imp] ementation of a production system. will draw _ further nodes 
and links into active memory, the selection of a particular production system 6 
for implementation is determined by an initial activation of memory, and -t 
is this active portion alone that is accessible. 

The structure and content of this activated portion of memory are the 
result of the decision maker's structuring of the task environment. The mar.n 
report discusses how the activation is done, using detailed examples. 
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